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HOW  TO  USE  THIS  PERFORMANCE  GUIDE 


1.  Determine  the  purpose  of  your  CTEA;  e.g.,  does  the  CTEA  have  to 
be  a  complete  cost  and  training  effectiveness  analysis  or  is  it 
only  to  resolve  some  specific  issue  or  issues?  (See  Section  I.) 

2.  Refer  to  the  General  CTEA  Model  (Figure  II-1)  to  help  you  assess 
what  data  are  available  to  you.  (See  also  the  text  in  paragraph 
HE  starting  on  page  II-3.) 

3.  Determine  the  specific  issues  that  require  resolution.  (See 
discussion  in  paragraph  IIC  starting  on  page  II-5  and  Table  II-2 
on  page  11-16.) 

4.  Study  the  series  of  strategies  for  performing  CTEA  discussed 
in  paragraph  IID  starting  on  page  II-6. 


5.  Proceed  to  Table  II-3  (page  11-17),  "How  to  Proceed  from  Here." 


SECTION  I 


INTRODUCTION 


A.  Purpose  of  this  Performance  Guide 

This  is  a  "how  to"  manual.  It  shows  an  analyst  how  to  perform  cost  and 
training  effectiveness  analyses  (CTEA)  during  Weapon  System  Acquisition  required 
by  the  Life  Cycle  System  Management  Model  (LCSMM)  and  other  related  regulations 
and  documents .  The  Manual  assumes  that  the  analyst  has  a  working  knowledge  of 
Army  training  and  task  anaysis  but  may  not  be  an  expert  in  these  fields  or  in 
psychology  or  in  mathematics. 

You  will  note  throughout  the  Guide  the  frequent  use  of  the  word  "estimate." 
Whatever  the  method  for  CTEA,  you  will  be  dealing  in  estimates  rather  than  with 
exact  measures  and  you  should  be  guided  accordingly.  In  other  words,  it  will 
not  be  worth  your  while  to  strive  for  greater  accuracy  in  your  analyses  than  the 
input  data  warrant. 

8.  Purposes  of  the  CTEA 

1.  Evaluation  of  the  ease/ difficulty  of  training  system  casks. 

CTEAs  supply  evaluations  of  the  training  subsystems  at  several  points 
in  the  process  of  system  acquisition.  The  evaluations  allow  system  performance 
to  be  judged  (and  acquisition  decisions  made)  based  on  estimates  of  soldiers’ 
proficiency  or.  the  various  tasks.  The  CTEA  thereby  identifies  those  tasks 
likely  to  be  difficult  to  train,  providing  tne  Army  with  a  basis  for  requesting 
modifications  in  the  hardware  or  in  the  tasks. 

2.  Determination  of  the  relative  merits  of  alternative  training  plans. 

Where  alternative  training  plans  have  been  proposed,  the  CTEA  assesses 
the  likelihood  of  each  plan  producing  soldiers  trained  to  criterion  level  or 
that  level  at  which  they  perform  the  tasks  to  the  required  standards.  The 
comparison  of  alternatives  is  done  for  each  task  or  group  of  tasks,  enabling 
a  choice  of  the  more  effective  plan  or  a  combination  of  the  more  effective 
elements  of  several  plans. 

3.  Identification  of  likely  components  of  an  optimal  training  program. 

The  CTEA  examines  the  critical  tasks  to  be  performed  on  a  developing 
system  and  determines  the  training  methods  most  likely  to  produce  the  required 
proficiency  in  the  soldier. 

u.  Determination  of  training  subsystem  costs. 

The  CTEA  determines  the  cost  of  training  soldiers  to  proficiency  on 
the  critical  tasks  of  the  system.  The  impact  of  training  subsystem  cost  on 
the  total  cost  of  the  system  can  thereby  be  evaluated.  The  determination  also 
permits  cost  comparisons  among  proposed  alternative  training  subsystems. 
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C .  CTEA  Products 

1 .  The  CTEA  produces  an  estimate  of  the  effectiveness  of  training  for 
each  task  or  group  of  tasks,  e.g.,  the  percentage  of  trainees  achieving  cri¬ 
terion  level  on  a  test  of  performance  for  each  task  (such  as  SQT  or  end-of- 
course  test ) . 

2.  The  CTEA  produces  a  table  of  relative  effectiveness  or  merit,  comparing 
proposed  alternative  training  plans  (when  available)  for  each  critical  task. 

The  table  nay  be  defined  in  terms  of  relative  proficiency  measures  or  in  terms 
of  the  proportion  of  necessary  training  elements  or  variables  included  in  the 
alternative  plans. 

3.  The  CTEA  produces  a  list  of  those  training  elements  or  variables 
deemed  necessary  and,  depending  on  the  method  or  approach  selected,  may  show 
training  deficiency  (where  a  training  requirement  is  not  matched  by  the  training 
program),  training  excess  (where  training  element's  in  the  training  program  are 
not  required  by  the  task  description),  or  training  redundancy  (where  two  or  more 
media  or  methoas  meet  the  same  need) . 

4 .  The  CTEA  produces  an  estimate  of  the  costs  involved  in  training  the 
soldier  to  operate  and/or  maintain  the  system  in  the  field. 
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PLANNING  THE  CTEA 


A .  Overview 

Various  methods  have  been  developed  for  performing  CTEA.  The  inputs  and 
outputs  of  these  methods  differ  as  do  the  advantages  and  disadvantages  of  each. 

The  general  approach  in  this  Guide  is  to  break  the  CTEA  down  into  its  component 
processes  and  then  to  apply  that  method  which  maximizes  the  advantages  and 
minimizes  the  disadvantages  for  a  particular  process. 

Whatever  the  location  of  the  CTEA  within  the  LCSM,  the  selection  of  methods 
for  the  accomplishment  of  its  various  analytical  processses  is  controlled  pri¬ 
marily  by  the  available  data.  The  issues  to  be  resolved  and  the  questions  to  be 
answered  by  the  CTEA  must  also  influence  the  selection  of  methods  once  the  nature 
of  the  relevant  data  has  been  determined.  Thus,  method  selection  begins  with  the 
identification  of  the  basic  analytical  processes  made  necessary  by  the  relative 
sparseness  or  richness  of  the  data  and  then  proceeds  to  the  selection  of  ways  to 
accomplish  those  processes.  After  these  initial  selections,  the  means  of  address¬ 
ing  the  specific  issues  and  questions  of  the  CTEA  must  be  considered.  This  ap¬ 
proach  to  the  selection  of  CTEA  methods  is  illustrated  in  Figure  II— 1  and  further 
explained  below. 
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B.  Assessment  of  Available  Data 


How  well  a  CTEA  can  be  done  and,  to  some  extent,  where  in  the  system  acqui¬ 
sition  process  it  should  be  done  are  highly  dependent  on  the  amount  and  types 
of  data  available.  As  the  system  progresses  through  the  acquisition  process, 
more  and  better  data  become  available.  The  necessary  data  will  probably  not 
be  readily  available  and  you  will  have  to  look  for  it.  Perhaps  the  most  diffi¬ 
cult  task  in  the  CTEA  will  be  data  collection  —  especially  in  the  early  stages 
of  system  acquisition.  This  will  be  particularly  true  of  cost  data. 

Once  the  performance  of  a  CTEA  has  been  directed,  you  must  first  ask  whether 
a  training  program  (.including  tasks  to  be  trained,  methods  to  train  tasks,  per¬ 
sonnel  to  be  trained,  locations  of  training  for  various  tasks,  etc.)  actually 
exists.  Depending  on  the  answer  to  this  question,  your  analysis  will  proceed 
along  one  of  two  primary  tracks  (Figure  II-1). 

1 .  If  there  is  no  training  program,  determine  if  there  is  a  task  list 
complete  enough  to  permit  design  or  prediction  of  alternative  training  programs 
(at  least  for  the  mission-critical  tasks). 

o  If  there  is  no  such  task  list,  or  if  it  is  not  complete 
enough  to  develop  alternative  training  programs,  a  task 
list  must  be  generated. 

o  Once  a  task  list  has  been  generated,  or  you  have  determined 
that  a  complete  enough  task  list  exists,  select  a  method  or 
methods  for  the  training  prediction  process. 

o  After  selecting  these  methods,  select  methods  for  the  re¬ 
maining  processes: 

o  estimation  of  effectiveness 

o  costing  of  training  program  alternatives 

o  cost  effectiveness  comparisons  of  training  programs 

o  resolution  of  issues 

2.  If  there  is  a  training  program,  analysis  will  proceed  along  the  other 
primary  track  (Figure  II-i). 

o  Determine  if  there  are  performance  data  complete  enough  and 
valid  enough  to  permit  empirical  evaluation  (based  on  actual 
performance)  of  the  effectiveness  of  the  training  program 
alternatives. 

o  If  there  are  no  such  data,  select  a  method  or  methods 
for  estimating  effectiveness. 

o  If  there  are  performance  data,  determine  if  these  are 
based  or.  a  single  program  or  on  a  set  of  program 
alternatives. 
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-  If  there  are  no  such  alternatives,  determine  how 
to  predict  or  develop  alternatives,  and 

-  determine  how  to  estimate  the  effectiveness  of  the 
alternatives . 

o  Cnee  you  have  made  these  decisions,  proceed,  as  in  paragraph  1 
above,  to  select  methods  for  the  remaining  processes: 

o  costing  of  training  program  alternatives 

o  cost  effectiveness  comparisons  of  training  programs 

c  resolution  of  issues 
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Issues  Requiring  Resolution 


The  issues  which  you  must  address  in  order  to  assist  the  decision-makers 
vary  with  the  particular  phase  of  the  system  acquisition  process.  During  Phase 
I,  Conceptual,  the  main  questions  will  probably  be: 

o  To  what  extent  is  the  basic  concept  trainable? 

o  What  training  program  elements  (e.g.,  delivery  approach,  media) 
should  be  included  in  the  program? 

o  What  is  the  estimated  cost  of  training  the  required  number  of  people 
to  proficiency  on  the  system? 

As  more  data  become  available  in  Phase  I  with  the  development  of  the  Letter 
of  Agreement  (LOA)  and  organizational  and  operational  concepts,  the  CTEA  can  be 
updated.  You  should  now  consider  issues  such  as: 

o  What  is  the  relative  trainability  of  alternative  concepts? 

o  What  is  the  relative  cost  of  effectiveness  of  the  training  pro¬ 
grams  for  the  alternative  concepts? 

As  the  acquisition  process  moves  into  Phase  II,  Demonstration  and  Valida¬ 
tion,  more  data  become  available,  such  as  Section  V  (Training  Plan)  of  the 
Outline  Acquisition  Plan  (OAP)  and  the  results  of  DT/OT  I.  The  issues  of  train- 
ability  and  relative  cost  effectiveness  of  alternatives  remain.  Now,  however, 
your  CTEA  should  resolve  the  issue  of  necessary  revisions  of  the  training  pro¬ 
grams.  As  the  Provisional  Qualitative  and  Quantitative  Personnel  Requirements 
Information  (PQQPRI)  becomes  available,  you  will  want  to  update  your  CTEA  to 
help  resolve  the  issues  of  training  device  requirements  (TDR)  and  the  relative 
cost  effectiveness  cf  the  revised  training  programs.  Trainability  of  these 
programs  remains  an  issue. 

When  the  acquisition  cycle  moves  into  Phase  III,  Full  Scale  Development, 
enough  additional  data  should  have  been  generated  to  warrant  another  CTEA. 

Events  that  provide  the  additional  data  are  the  beginning  of  New  Equipment 
Training  (NET)  based  on  the  NET  Plan,  approval  of  the  Acquisition  Plan  (AP), 
the  results  of  DT/OT  II,  the  evaluation  of  the  effect  the  new  system  will  have 
on  ARTEP,  draft  training  programs,  and  field  manuals  (FM).  The  primary  issues 
to  be  resolved  by  this  CTEA  are: 

o  the  performance  data  from  DT/OT  II  versus  the  standards  of  per¬ 
formance  developed  in  the  training  plans  and  documents 

o  the  impact  of  the  performance  data  on  hardware  and  training  — 
program  design,  personnel  selection,  hardware  modification,  etc. 

This  CTEA  should  be  updated  in  Phase  IV,  Production  and  Development,  based 
on  DT/OT  III  Reports,  revisions  of  training  plans  and  programs  (e.g.,  SQT,  ARTEP), 
FM,  and  Section  V  of  the  DP.  An  update  may  be  occasioned  during  deployment  if 
there  is  a  product  improvement  or  modification  program.  The  primary  issue  to 
be  addressed  in  this  phase  is  the  cost  effectiveness  of  the  revised  program. 


D,  Strategies  for  Conducting  the  CTEA 

In  order  to  assist  you  in  conducting  the  CTEA  and  selecting  methods  to  per¬ 
form  the  CTEA,  the  following  strategies  or  general  plans  have  been  developed. 

While  they  do  not  cover  every  conceivable  situation,  they  do  cover  those  situ¬ 
ations  that  can  be  reasonably  expected  to  occur. 

Strategy  1 

Situation ;  There  is  no  training  program  and  there  is  no  complete  task  list. 

Processes  Required  by  the  General  CTEA  Model: 

o  Generation  of  a  task  list 

o  Prediction  of  training  programs 

o  Estimation  of  effectiveness 

o  Costing  cf  training  programs 

o  Comparison  of  training  program  alternatives 

o  Resolution  of  issues 

Elements: 

o  Generation  of  a  task  list.  Determine  the  status  of  the  task  information 
and  choose  an  appropriate  method.  If  the  CTEA  is  to  be  done  early  in  an  acquisi¬ 
tion  program  —  that  is,  during  the  conceptual  phase  —  a  rudimentary  task  list 
may  be  adequate  though  it  should  be  as  refined  as  is  possible  within  CTEA  study 
resources.  The  "generic  CTEA"  processes  used  for  the  DIVAD  Gun  may  be  useful. 

If  tasks  can  be  inferred  from  a  contractor’s  draft  TM  or  from  knowledge  of  an 
antecedent  system,  use  3  process  like  the  HAWK  Product  Improvement  Program  (PIP) 
Training  Development.  If  the  CTEA  is  to  be  done  in  a  later  stage  of  acquisition  - 
demonstration  and  validation  phase  or  later  —  a  rudimentary  task  list  probably 
will  not  be  adequate,  and  considerable  effort  should  go  into  producing  a  refined 
task  list.  If  you  have  detailed  knowledge  of  the  antecedent  system,  use  the 
ROLAND  Training  Development  Process  to  generate  the  task  list.  (See  Table  II-1). 

o  Prediction  of  training  program  alternatives.  Predict  or  estimate  train¬ 
ing  program  alternatives  in  several  ways.  Estimate  one  training  program  on  the 
basis  of  expert  knowledge  of  the  weapons  or  materiel  system  under  investigation 
cr  expert  knowledge  of  the  class  of  weapons  or  materiel  systems  to  which  the 
developing  system  belongs.  .Then  use  an  analytical  method  such  as  the  Training 
Efficiency  Estimation  Model  (TEEM)  or  the  Modified  Training  Effectiveness, 

Cost  Effectiveness  Prediction  Technique  (TECEPF  to  predict  one  or  more  alter¬ 
natives.  (See  Table  ll-l.) 


Jorgensen  and  Hoffer,  Prediction  of  Training  Frograms  for  Use  in  Cost 
Training  Effectiveness  Analysis,  1978. 

p 

‘■Braby  et.al. ,  A  Technique  for  Choosing  Cost-Effective  Instructional 
Delivery  Systems,  T AEG  Report  No.  1 6 ,1975 - 
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Such  a  procedure  allows  the  products  of  expert  judgment  to  be  compared 
with  the  products  of  analytical  methods  and  vice  versa.  Wide  differences  in 
the  training  programs  predicted  or  estimated  by  two  such  divergent  methods  can 
identify  areas  that  require  closer  examination. 

o  Estimation  of  effectiveness.  In  the  case  of  a  training  program  estimated 
on  the  basis  of  expert  knowledge,  estimate  effectiveness  also  on  the  basis  of 
expert  knowledge.  If  a  task  under  examination  is  similar  to  a  task  in  an  exist¬ 
ing  system  about  which  the  analyst  has  knowledge,  and  if  it  is  known  that  a 
certain  training  approach  results  in  the  required  level  of  proficiency  on  the  task, 
the  training  approach  may  be  estimated  to  be  roughly  as  effective  in  training  the 
new  task  as  in  training  the  existing  task.  If  the  Analogous  Task  Method  (ATM,  a 
formal  analytical  procedure)  has  teen  used  to  predict  a  training  program  alterna¬ 
tive,  use  it  also  to  estimate  the  effectiveness  of  that  program.  If  TEEM  has  been 
employed  to  estimate  two  or  more  alternatives ,  the  efficiency  ratios  become  the 
estimates  of  effectiveness.  No  matter  how  the  training  program  alternatives 
have  beer,  predicted  or  estimated,  Training  Consonance  Analysis  (TCA,  may  be 
used  to  estimate  effectiveness.  The  training  consonance  ratios  (TCR)  produced 
by  the  method  become  the  estimates  of  effectiveness.  (See  Table  II— 1 . ) 

o  Costing  of  training  program  alternatives.  Use  the  modified  TECEP  (TAEG 
#16)  Cost  Model  to  estimate  costs'.  Any  cost  model  that  yields  satisfactory 
cost  estimates  may  be  used,  but  this  one  is  automated,  comprehensive,  and 
apparently  satisfactory  for  Army  acquisition  decisions.  (See  Table  II- 1  and 
Section  HID,  p.  Ill -77.) 

o  Comparison  of  training  program  alternatives.  Compare  training  programs 
first  on  the  basis  of  estimated  cost  and  estimated  effectiveness.  Form  cost/ 
effectiveness  (C/E)  ratios  (estimated  cost  over  estimated  effectiveness,  but 
all  estimates  must  be  in  the  same  terms,  i.e.,  produced  by  t'ne  same  method)  and 
tentatively  choose  the  lower  value  since  it  represents  the  lowest  or  lower  cost 
per  "unit"  of  effectiveness.  Decide  which  estimated  level  of  effectiveness  is 
acceptable  (not  totally  a  judgmental  process;  see  TEEM)  and  eliminate  or  revise 
alternatives  with  a  lower  estimated  effectiveness.  Defer  final  selection  or 
reconmendation  of  a  training  program  alternative  until  all  issues  have  been  re¬ 
solved.  It  may  be,  for  example,  that  the  training  program  with  the  highest  C/E 
value  may  be  the  best  choice  when  considered  in  the  light  of  training  risk. 

This  would  be  the  case  if  a  training  program  were  estimated  to  be  more  effective 
in  training  certain  high-risk  tasks  but  were  also  estimated  to  be  somewhat  more 
costly  than  the  next  best  program.  Possible  impacts  of  training  risk  may  indi¬ 
cate  that  the  more  effective  program  is  worth  the  higher  costs.  Refer  to  Table 
II- 1  and  read  the  techniaues  referred  to  ’under  Column  F,  Resolution  of  Issues. 
These  issues  may  correspond  to  yours  or  similar  techniques  may  be  useful  in  re¬ 
solving  the  issues  you  must  address. 

c  Resolution  of  issues.  Identify  issues  or  questions  (frequently  referred 
to  as  EEA  for  essential  elements  of  analysis)  not  already  resolved  by  the  pre¬ 
ceding  processes,  ar.d  choose  or  develop  approaches  to  them.  These  approaches 
may  include  recommendations  for  further  studies  or  tests.  (See  Table  II— 1 . ) 


^ Hawley  and  Thomason,  Development  of  an  Air  Defense  Cost  and  Training 
Effectiveness  Analysis  Methodology,  2  vcl.,  *378. 

^The  modification  of  the  cost  model  is  a  Litton  modification  (see  Section 

iiid). 
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Strategy  2 


Situation:  There  is  no  training  program  but  there  is  a  complete  task  list. 
Processes  Required  by  the  General  CTEA  Model: 
o  Prediction  of  training  programs 

o  Estimation  of  effectiveness 

o  Costing  of  training  programs 
o  Comparison  of  training  program  alternatives 

o  Resolution  of  issues 

Elements: 

o  Prediction  of  training  program  alternatives.  As  in  Strategy  1 ,  estimate 
training  program  alternatives  in  several  ways,  including  both  informal  methods 
based  on  expert  judgment  and  formal  analytical  methods  such  as  TEEM,  TECEP,  ATM, 
and  DIVAE  Gun.  Compare  the  results  of  the  various  methods  and  resolve  differ¬ 
ences.  Be  aware  that  if  the  analyst  faces  the  situation  very  early  in  an  acqui¬ 
sition  program,  the  training  program  predictions  or  estimations  need  not  be  as 
precise  as  they  will  need  to  be  at  later  stages.  Still,  make  predictions  or 
estimations  as  precisely  as  the  task  information  permits.  (See  Table  II— 1 . ) 

o  Estimation  of  effectiveness.  Estimate  effectiveness  as  in  Strategy  1 , 

Be  aware  that  the  state  of  the  task  information  (a  rudimentary  task  list,  a  some¬ 
what  refined  task  list,  or  a  set  of  Hilly  developed  task  statements)  determines 
the  precision  with  which  training  programs  may  oe  predicted  or  estimated  and 
their  effectiveness  estimated. 

o  Costing  of  training  programs.  Cost  training  programs  as  in  Strategy  1 . 

Be  aware  that  the  precision  or  accuracy  of  cost  estimates  depends  on  the  preci¬ 
sion  or  accuracy  of  estimation  of  training  programs.  (See  Table  II-1.) 

o  Comparison  of  training  program  alternatives.  Compare  training  program 
alternatives  as  in  Strategy  1 . 

o  Resolution  of  issues.  Resolve  issues  as  in  Strategy  1 .  Because  the 
situation  that  this  strategy  addresses  is  likely  to  occur  during  the  concept  ex¬ 
ploration  phase  of  an  acquisition  program  when  competing  materiel  concepts  are 
being  explored,  be  especially  aware  that  the  issue  of  trainability  is  important. 
(See  Table  II- 1.) 


Strategy  3 

Situation:  There  is  a  training  program  but  there  are  no  alternatives  and 
no  effectiveness  data. 

Processes  Required  by  the  General  CTEA  Model: 
o  Prediction  of  training  programs 

o  Estimation  of  effectiveness 

o  Costing  of  training  programs 
o  Comparison  of  training  program  alternatives 

o  Resolution  of  issues 

Elements : 

o  Prediction  of  training  program  alternatives.  Use  a  formal  analytical 
procedure  such  as  TEEM,  TECEP,  or  ATM  to  predict  training  program  alternatives 
to  be  compared  with  the  existing  training  program.  A  method  based  on  informal 
expert  knowledge  may  also  be  used,  but  because  of  the  method  to  be  used  in  the 
comparison  of  training  program  alternatives  the  details  and  relative  precision 
of  the  formal  analytical  procedures  will  be  useful.  Whatever  the  method  em¬ 
ployed,  consider  different  levels  of  training  device/media  usage,  especially 
levels  different  from  those  in  the  existing  program,  and  different  methods. 

(See  Table  II- 1.) 

o  Estimation  of  effectiveness.  Use  TCA  to  estimate  the  effectiveness  of 
both  the  existing  training  program  and  the  predicted  training  programs.  This 
method  yields  both  values  (TCRs)  which  may  be  taken  as  estimates  of  effectiveness 
and  diagnostic  information  (training  deficiencies,  excesses,  and  redundancies) 
which  may  be  used  to  recommend  revisions  of  the  existing  training  program.  A 
method  based  on  expert  knowledge/ judgment  may  also  be  employed,  but  because  one 
training  program  actually  exists  while  the  alternatives  have  only  been  predicted 
(i.e.,  described)  the  possibility  of  biased  estimates  exists.  (See  Table  II-1.) 

o  Costing  of  training  programs.  Cost  training  programs  as  in  Strategy  1 . 
Because  one  training  program  to  be  costed  actually  exists  while  the  alternatives 
have  only  been  predicted  or  estimated,  be  aware  that  cost  estimates  must  be 
comparable  in  level  of  detail  and  precision  if  valid  cost  comparisons  are  to 
be  made.  (See  Table  II- 1.) 

o  Comparison  of  training  program  alternatives.  Compare  training  program 
alternatives  using  the  TCRs  as  estimates  of  effectiveness .  Combine  alternatives 
on  the  basi3  of  effectiveness  and  costs.  Form  cost/effectiveness  (C/E)  ratios 
as  in  Strategy  1  and  tentatively  choose  the  lowest  or  lower  value  since  it  repre¬ 
sents  the  lowest  or  lower  cost  per  "unit"  of  effectiveness.  Then  note  the  re¬ 
lationship  of  the  TCR3.*  if  the  TCRs  of  one  or  more  predicted  alternatives  are 
higher  than  the  TCR  of  the  actual  training  program,  compare  the  media  and  methods 
of  the  predicted  alternatives  —  task  by  task  —  with  the  media  and  methods  of 
the  actual  training  program.  Also  examine  the  actual  training  program  in  light 
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of  its  owr.  diagnostic  information  (training  deficiencies,  excesses,  and  redun¬ 
dancies)  and  the  diagnostic  information  pertaining  to  predicted  alternatives 
with  higher  TCRs.  This  information  can  be  used  to  reconmend  revisions  of  the 
actual  training  program  that  will  cause  its  TCR  and  thus  its  estimated  effective¬ 
ness  to  increase.  The  adoption  of  one  of  the  predicted  alternatives  may  also  be 
recommended,  should  comparison  of  C/E  values  warrant,  but  defer  final  selection 
or  reconmend at ion  of  a  training  program  until  all  issues  have  been  resolved. 

See  comparison  of  training  program  alternatives  in  Strategy  1 . 

o  Resolution  of  issues.  Resolve  issues  as  in  Strategy  1 .  Necessary  re¬ 
visions  of*  the  existing  training  program  are  likely  to  constitute  an  important 
issue,  but  the  resolution  of  it  will  have  been  accomplished  during  the  compari¬ 
son  of  training  program  alternatives. 

Strategy  U 

Situation :  There  is  a  training  program  with  effectiveness  data  but  there 
are  no  alternatives. 

Processes  Required  by  the  General  CTEA  Model: 
o  Prediction  of  training  programs 

o  Estimation  of  effectiveness 

o  Costing  of  training  programs 
o  Comparison  of  training  program  alternatives 

o  Resolution  of  issues 

Elements: 

o  Prediction  of  training  program  alternatives.  Predict  training  program 
alternatives  as  in  Strategy  3 . 

o  Estimation  of  effectiveness .  Estimate  the  effectiveness  of  all  alter¬ 
natives  (the  existing  training  program  and  the  predicted  alternatives) as  in 

Strategy  3.  There  are  effectiveness  data  for  the  existing  training  program, 
probably  performance  measures  from  DT.'OT,  but  the  comparison  of  alternatives 
requires  a  cocmon  measure,  and  this  can  be  provided  only  through  estimates  of 
effectiveness  such  as  TCRs.  The  TCRs  and  associated  diagnostic  information 
will  be  used  in  comparison  of  training  program  alternatives  as  a  basis  for 
recomnending  changes  in  the  existing  training  prgram  or  the  adoption  of  an 
alternative. 

o  Costing  of  training  programs.  Cost  training  programs  as  in  Strategy  1 . 

Be  aware  that  cost  estimates  must  be  comparable  in  level  of  detail  and  precision 
if  valid  cost  comparisons  are  to  be  made. 

o  Comparison  of  training  program  alternatives.  If  the  effectiveness  data 
of  the  existing  training  programs  are  performance  measures  (from  DT/07),  deter¬ 
mine  if  there  are  associated  task/training  objective  standards  or  test  criteria. 
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If  there  are  none,  proceed  as  in  Strategy  3,  comparison  of  training  program 
alternatives .  If  there  are  standards  or  test  criteria,  determine  if  the  perform¬ 
ance  measures  represent  a  deficiency  in  training,  the  required  level  of  training 
proficiency,  or  an  excess  of  training.  Next,  examine  the  TCA  diagnostic  information 
of  the  existing  training  program  to  tentatively  determine  how  that  training  pro¬ 
gram  could  be  revised  to  reduce  or  eliminate  training  deficiencies  or  excesses 
in  training.  Then,  determine  which  of  the  predicted  alternatives  have  TCRs 
higher  than  the  TCR  of  the  existing  training  program  and  compare  these  alterna¬ 
tives  —  task  by  task  —  with  the  existing  training  program  in  order  to  establish 
a  further  basis  for  reoomnending  revisions  of  the  existing  training  program  or 
selection  of  an  alternative.  Finally,  form  C/E  ratios  as  in  Strategy  1 ,  com¬ 
parison  of  training  program  alternatives,  and  tentatively  select  the  program 
with  the  lowest  or  lower  C/E  value  since  the  program  represents  the  lowest  cost 
per  "unit"  of  effectiveness.  But  if  standards  or  criteria  exist  and  the  existing 
training  program  represents  a  training  deficiency,  the  existing  training  program 
in  its  unrevised  form  must  be  eliminated  from  selection.  Compute  a  TCR  for  the 
existing  training  program  revised  as  reconmended ,  revise  the  cost  estimate  ac¬ 
cordingly,  and  form  a  new  C/E  ratio.  Compare  the  C/E  values  of  the  predicted 
alternatives  with  the  new  C/E  value.  Again,  choose  the  lowest  or  lower  C/'E 
values,  but  be  aware  that  the  cost  estimates  of  predicted  alternatives  must 
include  all  development  costs  while  the  cost  estimate  of  the  existing  training 
will  include  fewer  development’ costs  or  perhaps  none  at  all.  If  the  selection 
finally  made  is  an  existing  training  program  with  excesses  or  redundancies,  use 
the  TCA  diagnostic  information  to  make  recommendations  for  revisions  to  further 
increase  the  cost  effectiveness.  Defer  final  selection  or  reconmendations  of  a 
training  prgram  or  training  program  revision  until  all  issues  have  been  resolved. 


o  Resolution  of  issues.  Resolve  issues  as  in  Strategy  1 ,  but  be  aware 
that  training  device  requirements  (TDR)  will  likely  constitute  an  important  is¬ 
sue  and  a  method  for  predicting  or  considering  TDR  must  therefore  be  selected  or 
developed . 

Strategy  5 

Situation:  There  are  training  program  alternatives  but  not  effectiveness 
data  for  all  alternatives. 

Processes  Required  by  the  General  CTEA  Model: 

o  Estimation  of  effectiveness 

o  Costing  of  training  programs 

o  Comparison  of  training  program  alternatives 

o  Resolution  of  issues 

Elements: 

o  Estimation  of  effectiveness.  Estimate  the  effectiveness  of  all  existing 
alternatives  as  in  Strategy  3.  If1  all  alternatives  are  to  be  compared,  including 
tnose  without  effectiveness  data,  this  is  a  necessary  step. 


o  Costing  of  training  programs.  Cost  all  existing  training  program  alter¬ 
natives  as  in  Strategy  1 . 

o  Comparison  of  training  program  alternatives .  If  the  effectiveness  data 
for  two  or  more  alternatives  are  performance  measures  associated  with  task/ 
training  objective  standards  or  test  criteria,  first  eliminate  from  considera¬ 
tion  those  alternatives  whose  performance  measures  show  that  their  effectiveness 
is  unacceptable.  Then  compare  the  remaining  alternatives  on  the  basis  of  cost 
and  effectiveness.  Form  C/E  ratios  and  tentatively  select  the  training  program 
with  the  lowest  or  lower  C/E  value  since  it  represents  the  lowest  cost  for  ac¬ 
ceptable  effectiveness.  If  the  effectiveness  data  are  not  performance  measures 
or  if  there  are  no  associated  standards  or  criteria,  proceed  as  in  Strategy  3, 
comparison  of  training  program  alternatives.  If  there  are  performance  measures 
with  associated  task/training  objective  standards  or  test  criteria  for  only  one 
training  program,  proceed  as  in  Strategy  4,  comparison  of  training  program 
alternatives.  If  the  first  case  identified  above  prevails,  compare  all  alter¬ 
natives  on  the  basis  of  TCRs  (from  TCA) .  If  a  training  program  alternative 
without  performance  measures  has  a  higher  TCR  than  the  training  programs  with 
performance  measures,  consider  that  that  program  may  be  more  effective  than 
the  programs  with  performance  measures  and  reconmend  the  collection  of  perfor¬ 
mance  measures  to  verify  that  greater  effectiveness.  If  the  first  case  identi¬ 
fied  above  prevails  and  the  measures  of  performance  include  more  than  one  mea¬ 
sure  of  training  effectiveness  (MOTE) ,  then  use  BDM/CARAF^  to  compute  a  total 
weighted  effectiveness  score  and  use  this  value  to  form  a  C/E  ratio.  Defer 
final  selection  or  recoraaendation  of  a  training  program  until  all  issues  have 
been  resolved.  (See  Table  II -1.) 

o  Resolution  of  issues.  Resolve  issues  as  in  Strategy  1 .  Be  aware 
that  performance  versus  standards  and  performance  versus  hardware,  training 
program  design,  and  personnel  selection  are  likely  to  constitute  issues  to  be 
resolved. 

Strategy  6 

Situation:  There  are  training  program  alternatives  and  effectiveness  data 
for  all  alternatives. 

Processes  Required  by  the  General  CTEA  Model: 
o  Costing  of  training  programs 
o  Comparison  of  training  program  alternatives 
o  Resolution  of  issues 
Elements: 

o  Costing  of  training  programs.  Cost  all  training  program  alternatives  as 
in  Strategy  1 . 


C 

J3DM  Services  Company/ Combined  Arms  Research  and  Analysis  Facility  (BDM/ 

CARAF) ,  Cost  and  Training  Effectiveness  Analysis  Handbook  for  Action  Officers, 
1976. 
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o  Comparison  of  training  program  alternatives.  This  strategy  assumes  that 
*  all  effectiveness  data  are  comparable  and  that  effectiveness  data  are  performance 
measures  associated  with  task/' training  objective  standards  or  test  criteria. 
Should  the  assumption  not  be  true,  one  of  the  other  strategies  will  be  applicable. 
First  eliminate  from  consideration  those  alternatives  whose  performance  measures 
show  that  their  effectiveness  is  unacceptable.  (If  all  alternatives  are  thus 
eliminated  from  consideration,  use  TCA  for  diagnosis  and  reconmend  revision  and 
further  testing  of  programs.)  Then  compare  the  remaining  alternatives  on  the 
basis  of  cost  and  effectiveness.  Form  C/E  ratios  and  tentatively  select  the 
training  program  with  the  lowest  or  lower  C/E  value  since  it  represents  the 
lowest  cost  for  acceptable  effectiveness.  If  the  measures  of  performance  in¬ 
clude  more  than  one  measure  of  training  effectiveness  (MOTE),  then  use  BDM/CARAF 
to  compute  a  total  weighted  effectiveness  score  and  use  this  value  to  form  a  C/E 
ratio.  If  factors  other  than  performance  measures  are  to  be  considered  in  the 
selection  oD-an  alternative,  follow  the  Diagnostic  Rifle  Marksmanship  Simulators 
(DRIMS)  CTEAb  method.  Defer  final  selection  or  recommendation  of  a  training 
program  until  all  issues  have  been  resolved.  (See  Table  II— 1 . ) 

o  Resolution  of  issues.  Resolve  issues  as  in  Strategy  1 .  Be  aware  the 
central  issue  is  likely  to  be  the  cost/training  effectiveness  of  the  much-revised 
training  program  of  a  system  in  the  production  and  deployment  phase  of  acquisi¬ 
tion.  Performance  versus  standards  and  performance  versus  hardware,  training 
program  design,  and  personnel  selection  may  also  be  issues  to  be  resolved. 


^USAIS,  Diagnostic  Rifle  Marksmanship  Simulators  Cost  and  Training  Effec¬ 
tiveness  Analysis,  1978. 
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E.  Summary 

Table  II-2  is  a  sunraary  table  for  CTEA  in  the  LCSMM.  Table  II-3  is  an 
overview  of  how  to  proceed  from  here. 
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TABLE  II-3 


HOW  TO  USE  PROCEED  FROM  HERE 


o  Determine  your  "strategy."  See  discussion  of  strategies 
above  and  refer  to  Table  II-2. 

o  Examine  the  processes  required  and  methods  recomnended 
for  your  strategy.  Refer  to  the  processes  in  Section  III 
and  methods  to  perform  them. 

o  Select  an  appropriate  method  for  each  process  required 
by  your  strategy. 


o  Generation  of  a  task  list 
o  Prediction  of  training  programs 
o  Estimation  of  effectiveness 
o  Costing  of  training  programs 
o  Comparison  of  training  program  alternatives 
o  Resolution  of  issues 


o  Apply  the  methods 


SECTION  III 


PROCESS  PROCEDURES 


A.  Generation  of  Task  List 

1 .  DIVAD  Gan 

You  may  be  faced  with  a  situation  where  you  have  no  task  list  and, 
apparently,  no  data  on  which  to  base  the  generation  of  such  a  list.  A  CTEA, 
however,  may  still  be  required  as  necessary  to  the  milestone  decisions  of  the 
acquisition  process. 

Use  your  own  subject  matter  expertise  or  find  a  subject  matter  expert 
(SME)  to  help  you  develop  a  list  of  "generic"  tasks.  For  example,  if  the  de¬ 
veloping  system  is  an  air  defense  system  (such  as  DIVAD  Gun),  you  can  be  fairly 
certain  that  a  basic  task  will  be  "engage  enemy  aircraft."  You  can  al3o  be 
fairly  certain  that  a  basic  task  will  be  "maintain  the  system,"  etc.  If  you 
have  any  information  on  or  familiarity  with  the  developing  system,  you  can  then 
develop  more  detailed  tasks.  In  other  words,  there  are  certain  tasks  cr  kinds 
of  tasks  tnat  are  common  to  systems  of  a  similar  class,  and  there  is  consider¬ 
able  information  available  about  the  training  of  those  tasks. 

This  method  of  task  list  generation  is  somewhat  of  a  last  resort  based 
on  the  situation  where  even  the  most  tentative  and  tenuous  CTEA  is  preferable 
to  no  CTEA. 

2.  Improved  Hawk  (Hawk  PIP)  Training  Development 

You  may  be  required  to  generate  a  task  list  for  a  system  modification 
or  product  improvement  program  (PIP).  Where  you  have  a  system  modification, 
many  of  the  tasks  of  the  modified  system  will  be  identical  to  those  of  the  basic 
system,  and  the  training,  training  requirements,  and  training  implications  will 
also  be  the  same.  Where  tasks  have  been  added  or  changed,  however,  (through 
the  addition  of  a  materiel  subsystem,  for  example)  you  must  define  new  tasks. 

In  the  Hawk  PIP  training  development  tasks  were  inferred  from  the  manu¬ 
facturer's  draft  TM  material.  For  example,  the  manufacturer's  draft  TM  (see 
Figure  III-1)  states,  "When  estimating  raid  size  of  the  lock,  determine  the  num¬ 
ber  of  targets  in  an  assignment  ...  through  d  below."  This  task  implies  that 
there  is  a  task,  "determine  raid  size  using  the  Tracking  Adjunct  System.  (TAS)." 

If  you  still  have  difficulty,  you  may  have  to  request  the  actual  equip¬ 
ment  (as  was  done  in  Hawk  PIP)  in  order  to  work  out  problems  on  the  operational 
system. 


3.  Roland  Training  Development 

a.  Given  such  data  as  the  manufacturer's  Logistic  Support  .Analysis 
Record  (LSAR)  D  Sheets  and  draft  TM  (and,  if  possible  as  in  the  case  of  Roland 
training  development,  attendance  at  the  manufacturer's  training  course),  develop 
a  task  selection  work  sheet  similar  to  the  one  in  Figure  III-2. 


It  cease  fire  is  in  effect,  continue:  otherwise,  proceed  to  step  23. 
The  CEASE  PIKE  label  i»  illuminated. 


When  estimating  raid  size  after  lack,  determine  the  number  of  targets  in  an  assignment  by 
monitoring  the  doppler  audio  and  PPI  video.  Report  the  number  by  pressing  either  the  ONE. 
r  EW.  or  MANY  pushbutton  by  using  the  criteria  in  a  through  d  below. 

NOTE 

'For  TAS  equipped  IHAWK  batteries  both  the  TaS  visual  and  non-TA S criteria  detailed  below  should 
b»*  used. 


NOTE 

^P**r  IHAWK  batteries  without  TAS.  only  the  non-TAS  criteria  should  be' used. 

When  only  one  target  is  visible  or.  the  TASdi  Spl  ay  or  when  only  one  target  is  heard  in  the 
doppler  audio  tone,  and  the  target  video  on  the  PPI  is  unbroken,  press  the  ONE  pushbutton. 

The  ONE  pushbutton  on  the  firing  console  and  iKrONEIabel  on  the  I BCC  status 
indicator  illuminate. 

When  two  targets  are  visible  on  the  TASdi  S  pi  ayor  when  there  is  more  than  one  target  heard 
in  the  doppler  audio  tone,  and  the  target  video  on  the  PPI  is  unbroken,  press  the  FEW 
pushbutton. 


The  FETt  pushbutton  on  the  firing  console  and  the  FE^  label  on  the  1  BC.C  rtatus 
indicator  illuminate. 

When  there  are  more  than  two  targets  visible  on  the  TASdisplayor  when  there  are  many 
targets  heard  in  the  doppler  audio  tone,  and  the  target  video  on  the  PPI  is  broken  into  many 
targets,  press  the  MANY  pushbutton. 

The  MANY  pushbutton  on  the  firin&conMile  and  the  MANY  label  on  the  1BCC 
statu*  indicator  illuminate. 

Continue  to  monitor  the  status  of  the  engagement  by  observing  that  the  doppler  audio  tone 
remains  steady  and  the  COAST  label  extinguishes.  Report  any  irregular  indications. 

Continue  to  monitor  the  target  on  the  TASdi  spl  ay.Report  target  type,  weapons  store,  and 
target  maneuver,  if  discernible. 


If  more  than  one  target  is  visible  on  the  TAS  display: 

Manually  acquire  an  outlying  target  (a  target  at  the  edge  of  the  formation)  using  the  small 
Cate  target  acquisition  procedure  tstepuld). 

Press  the  TAS  SLAVEO/INDEP  indicator-switch  to  SLAVED. 

Press  the  TAS  PI  CS/PI  OFF  Indicator-switch  to  PI  ON. 


Figure  Ill-i.  Reproduction  of  Page  from  Manufacturer’s  Draft  TM 
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b.  Go  through  the  tasks  on  the  LSAR  D  Sheets  and  find  them  in  the 
draft  TM.  The  draft  TM  will  usually  be  a  refinement  and  expansion  of  the  LSAR 
tasks.  List  the  tasks  on  the  task  selection  worksheet.  Ask  the  manufacturer 
(through  appropriate  channels)  to  explain  where  necessary. 

c.  Apply  your  subject  matter  expertise  and  military  judgment  to  rating 
these  tasks  on  the  worksheet  for: 

(1)  Number  of  people  performing  the  task  (column  c) 

(2)  Time  spent  in  performing  the  task  (colrnn  d) 

(3)  Consequences  of  inadequate  performance  (CCIP)  (column  e) 

(4)  Task  delay  tolerance  (TDT)  or  effect  on  mission  if  not 
done  in  time  (column  f) 

(5)  Task  learning  difficulty  (TLD)  (column  g) 

(6)  Task  frequency  or  how  often  the  task  is  performed 
(column  h) 

d.  In  columns  i-nf  place  an  x  in  each  task  cell  for  the  tasks  that 
scored  at  least  the  nunber  shown  in  the  column  heading.  For  example,  in  column 
i  for  task  #1 ,  place  an  x  if  the  colunn  c  entry  is  5  or  6.  It  is  5  sc  an  x  is 
shown.  For  column  j  the  criterion  .is  that  column  d  entry  be  4  or  higher.  The 
column  d  entry  for  task  #1  is  3  so  enter  a  0.  Do  this  for  all  tasks. 

e.  Refer  to  the  "Truth  Table"  at  the  top  right  of  the  worksheet.  Find 
the  horizontal  line  of  X's  and  0's  that  corresponds  to  the  pattern  of  X's  and 
0’s  you  have  entered  for  the  task.  The  "Truth  Table"  then  gives  you  the  entries 
for  that  task  for  columns  o-r: 

(1)  column  o:  is  the  task  critical? 

(2)  column  p:  should  the  task  be  taught  as  resident  instruc¬ 
tion  or  extension  instruction? 

(3)  column  q:  should  the  task  be  included  in  the  ARTEP? 

(4)  column  r:  should  the  task  be  included  in  wartime 
training? 


f.  Complete  the  Matrix  Task  Inventory  such  as  the  one  shown  in  Figure 
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**  b(r 

MATRIX  TASK  INVENTORY 

{iltt 

Roland  Critical  Task 
MOS  1 6(5 


TRAINING 

SITE 


TASK/  CATEGORY  N. 

P  ■  Perform  N. 

S  «  Supervise 

x  ■  Applicable 


1.  Perform  Exterior  Ground  Level  Inspection  (PMCS 

2.  Insoect  Road  Idler  Wheels 

3.  Inspect  Pinal  Orive 

4.  Inspect  Track  End  Connector  &  Pads 

5.  Inspect  Inverter  Access  Panel 
S.  Insoect  Condensor  Fan  Outlet 

7.  Inspea Environmental  Control  Unit  (ECU) 

S.  Inspect  Rear  Cabin  Ooor 

9.  Inspect  EC'J  Fresh  Air  Filter 

10.  Insoect  ECU  Return  Air  Filter 

11.  Inspect  Prime  Power  Unit  (PPU)  Elapsed  Time 

Meter 

12.  Insoect  Carrier  Lights 

13.  Inspect  PP'J 

14.  Inspect  External  Pwr  Connector 

15.  Insoect  Coraiun  lest  ion  31nd1ng  Posts 

16.  Insoect  Emergency-Off  Cover 

17.  Inspect  PPU  Cay  Tank  Oriln  Valve 

13.  Inspect  ?-U  Main  Fuel  Tank 

19.  Insoect  Coolant  Level 

20.  Inspect  Oil  Level 

21.  Inspect  Can/Al ternator  Orive  Belts 

i 

22.  Insoect  Power  Junction  Box 

23.  Insoect  Fire  Unit  Hull 

i 

24.  Insoect  Carrier  Air  Filter 

25.  Insoect  er;nt  Carrier  Lights 

25.  Insoect  wheel  huos/Shock  Absorbers 

27.  Insoect  "'sek  Adjuster 


fS  Tore  1139b  (USAAOS )  15  Mar  "3  r— — 

rlfur*  Matrix  Taak  Inventory 
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B.  Prediction  of  Training  Programs 


Certain  kinds  of  learning  are  facilitated  by  particular  types  of  training. 
The  kinds  of  learning  required  are  determined  from  a  study  of  the  learning  ob¬ 
jectives  and,  more  positively,  the  action  verb  in  the  task  statement.  It  is 
this  action  verb  that  is  the  major  clue  as  to  what  it  is  that  the  soldier  must 
do.  Several  methods  have  been  developed  that  assist  the  analyst  in  designing  an 
instructional  delivery  system  based  on  training  objectives  and  their  supporting 
kinds  of  learning.  We  will  first  look  at  those  that  can  help  the  process  of 
predicting  training  program  alternatives. 

1.  TEEM  (Jorgensen  and  Hoffer,  Prediction  of  Training  Programs  for  Use  in 

Cost  Training  Effectiveness  Analysis,  1 97B )*  ” 

In  the  early  stages  of  development  new  systems  have  no  training  pro¬ 
grams  to  serve  as  a  basis  of  comparison.  In  the  case  of  truly  innovative  sys¬ 
tems,  furthermore,  there  are  no  analogous  systems  with  training  programs  that 
could  provide  base  cases.  A  predictive  computerized  model  for  CTEA  use  has  thus 
been  developed  by  Jorgensen  and  Hoffer  (1978).  Their  methodology,  called  TEEM 
for  Training  Efficiency  Estimation  Model,  begins  with  task  analysis,  proceeds 
through  selection  of  training  media  and  methods,  identifies  information  content 
and  structure,  and,  finally,  generates  a  cost/effectiveness  ratio  for  use  in 
CTEA.  Iterations  of  the  model  may  be  made  for  various  training  weapon  system 
options  in  order  to  produce  cost/effectiveness  ratios  for  comparison. 

In  this  model  the  trade-offs  made  during  the  generation  of  an  estimated 
training  program  are  recorded.  These  are  used  to  determine  the  potential  deci¬ 
sion  cost  loss  for  the  chosen  training  program  as  compared  with  an  ideal  program 
with  no  constraints.  That  is,  an  ideal,  unconstrained  program  is  quantified  and 
then  compared  with  a  similarly  quantified  real-world  (constrained)  training  pro¬ 
gram.  This  measure  provides  a  standard  of  comparison  for  several  training  pro¬ 
grams  generated  with  the  same  CTEA  method  and  has  potential  advantages  not  only 
for  the  comparison  of  alternative  programs  for  a  given  weapon  system  but  also 
for  comparison  across  systems. 

The  measure,  the  efficiency  ratio,  represents  a  value  composed  of  the 
efficiency  score  of  an  estimated  program  with  real  world  constraints  divided  by 
the  efficiency  score  of  an  idealized  program  with  no  constraints.  Outputs  of 
this  method  also  include  a  costed  training  program.  Input  is  a  task  list  along 
with  sufficient  knowledge  of  the  weapon  system  to  permit  inferences  about  the 
nature  of  stimuli,  responses,  and  feedback. 

TEEM  uses  set3  of  variables  to  describe  both  the  tasks  to  be  learned 
and  the  means  for  training  them  (media  and  methods) .  The  authors  plan  to  add 
other  variables  in  the  future,  but  TEEM  can  be  used  to  develop  or  predict  train¬ 
ing  programs  as  it  is  currently  constituted.  Once  the  tasks  and  the  means  for 
learning  have  been  described  in  terms  of  the  same  variables,  matching  is  possi¬ 
ble.  Thus,  when  each  variable  in  the  description  of  the  task  is  matched  by  the 
corresponding  variable  in  the  descriptions  of  the  training  program,  an  ideal 
training  program  has  been  identified.  That  is,  for  each  stimulus,  response, 


*The  procedures  herein  have  been  taken  from  or  adapted  from  the  cited 
J  or gensen-Ko  f f er  re  port . 
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and  feedback  requirement  implied  by  the  tasks,  there  is  a  medium-method  combina¬ 
tion  in  the  training  program  to  meet  the  need.  But  because  of  costs  and  other 
constraints  such  an  ideal  training  program  cannot  be  achieved.  Rather,  as  the 
result  of  designing  a  training  program  within  real-world  constraints  something 
less  than  an  ideal  program  is  actually  achieved.  The  difference  is  expressed 
by  an  efficiency  ratio  that  will  be  explained  in  Section  IIIC. 

The  task  variables  you  will  deal  with  fall  within  three  classes: 
stimuli  or  cues,  response  or  answering  action  to  the  stimulus,  and  feedback  or 
information  to  the  operator  concerning  results  of  his  action.  In  addition, 
there  are  method  and  media  variables.  Procedures  for  using  these  variables 
to  predict  or  develop  training  programs  are  discussed  in  the  context  of  the 
following  example. 

a.  Start  with  a  task  description.  If  there  is  none,  you  will  have 
to  generate  the  task  list  (see  Section  IIIA,  above).  For  illustrative  pur¬ 
poses,  we  will  use  the  following  task  description: 

Task: 

Perform  subsystem  equipment  failure  reconfiguration  using 
DTM-9- 1430-650- 10 ,  Chapter  2,  under  task  condition  levels  1  and  2,  within 
three  minutes. 

1 .  Detect  console  malfunction  by  observing  Plan  Position 
Indicator  (PPI)  displays. 

2.  Upon  detection  of  malfunction,  use  keyboard  printer  unit  (KPU) 
to  select  alternate  console. 

3.  Analyze  keyboard  "TMON"  printouts  to  verify  correct  operation. 

b.  Compare  the  task  description  to  the  variables  listed  under  "Media 
Related  Variables  —  Stimuli  Characteristics,"  Annex  A,  Appendix  1.  Note  that 
comparison  of  the  task  and  variables  list  1-7,  shows  only  variable  1  to  be  ap¬ 
plicable.  Because  variables  2-7  do  not  apply,  they  can  be  eliminated,  along 
with  variables  25-30,  which  apply  to  audio  stimuli  only.  Variables  8-24  and 
31-39  must  now  be  screened  for  their  applicability  to  the  task  description.  If 
a  variable  is  shown  to  be  applicable  it  is  scored  with  a  1 ,  and  if  it  is  shown 
to  be  non-applicable,  it  is  scored  with  a  0.  These  scores  are  kept  on  separate 
coding  sheets,  like  the  one  shown  in  Figure  111-4. 

The  example  task  description  involves  observation  of  PPI  displays. 
Normally,  the  "Visual  Forms,"  variables  8-1 3,  which  can  be  presented  on  PPI 
displays,  include  alphanumeric ,  symbolic,  and  graphic  material  (8,  9,  and  10), 
but  do  not  include  other  forms,  such  as  pictorial,  solid  object,  or  environmental 
scenes  (11,  12,  and  13).  Variables  8,  9,  and  10  would  each  be  coded  as  1  on  the 
coding  sheet,  wiiile  variables  11,  12,  and  13  would  be  coded  as  0.  A  similar 
procedure  is  used  for  ail  applicable  variables.  For  instance,  stimuli  found  on 
PPI  displays  may  change  at  any  time,  and  are,  therefore,  not  static  (31).  Stim¬ 
uli  presented  on  the  radar  displays  are  also  quite  random  (33).  rather  than 
ordered  (32).  Therefore,  variables  31  ana  32  would  be  scored  with  a  0  and  33 
would  be  scored  with  a  1 .  Once  the  entire  list  of  of  applicable  variables  has 
been  screened  anc*  scored  on  the  coding  sheet,  using  the  above  procedure,  the 
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task  will  have  been  described  in  terms  of  the  variables  for  the  stimulus  situa¬ 
tion.  (See  the  first  row  of  the  Sample  Coding  Sheet,  Figure  III-4  for  the  ap¬ 
plicable  variables  for  this  sample  task.) 

c.  Now  compare  the  task  description  to  the  variables  listed  under 
"Media  Related  Variables  —  Response  Characteristics"  in  Appendix  2  to  Annex  A. 
Only  the  physical  properties  of  the  equipment  which  receive  the  operator's  re¬ 
sponse  to  the  stimulus  are  considered.  In  this  example,  note  that  the  operator's 
response  is  an  overt  one,  i.e.,  visible,  and  involves  the  manipulation  of  but¬ 
tons  on  the  KPU.  Thus,  variables  1,  2,  4,  and  5  are  coded  as  a  0,  and  3  is 
coded  as  a  1  on  the  coding  sheet.  Likewise,  the  responses  are  not  major  physical 
movements  and  are  coded  as  weak  intensity  responses  (6).  The  trainee  is  manipu¬ 
lating  equipment,  the  responses  he  produces  will  be  dynamic-ordered  (9)  and  the 
equipment  must  be  capable  of  accepting  such  a  response.  Similarly,  the  response 
rate  would  probably  be  fast  (12),  the  number  of  response  channels,  limited  (13), 
and  the  response  distribution,  individual  (15).  (See  the  second  row  of  the 
Sample  Coding  Sheet  for  the  applicable  variables  for  this  sample  task.) 

d.  Now  code  the  task  in  the  same  manner  for  feedback  variables,  Ap¬ 
pendix  3  to  Annex  A.  In  this  example,  the  medium  of  information  is  written 
form  (3).  The  source  of  feedback  is  intrinsic  (not  visible  from  the  outside) 
(10),  the  type  cf  feedback  is  both  response  consequences  04)  and  system  status 
(15),  and  the  feedback  distribution  is  again  individual  (16).  (See  third  row 
of  the  Sample  Coding  Sheet  for  the  applicable  variables  for  this  sample  task.) 

e.  After  you  have  recorded  the  task  information  in  terms  of  variables 
directly  related  to  equipment  choice,  one  other  evaluation  is  required.  The 
group  of  tasks  must  now  be  recoded  in  terms  of  functional  context  (expected 
operational  environment)  variables  for  method.  Because  this  example  only  deals 
with  a  single  task,  this  coding  is  somewhat  artificial,  since  normally  a  method 
would  not  be  chosen  for  a  single  task  situation,  but  rather  the  overall  func¬ 
tional  context  within  which  a  cluster  of  related  tasks  would  be  performed.  The 
method  variables  are  found  in  Appendix  4. 

Coding  the  task  for  method  requires  the  same  logic  used  to  code  the 
media.  For  this  sample  task,  the  role  performed  by  the  operator  in  the  real 
environment  is  individual  performance  (3).  The  functions  performed  in  the  role 
are  primarily  mental  in  terms  of  analyzing  the  "TMON"  printouts  (4),  physical  in 
terms  of  selecting  an  alternate  console  (5),  and  perceptual  in  terms  of  observing 
PPI  displays  (6).  The  function  is  basically  stable  (9),  since  it  does  not  change 
often.  The  impact  of  the  physical  context  (10)  and  psychological  context  (12)  is 
low.  (See  the  fourth  row  of  the  Sample  Coding  Sheet  for  the  applicable  variables 
for  this  sample  task.) 

f.  Appendix  5  is  a  listing  with  complete  descriptions  of  38  items  of 
training  equipment  and  materials  each  of  which  is  numbered.  Figure  III-5  is  a 
matrix  which  shows  the  numbers  of  the  item  of  training  equipment  and  materials 
across  the  top  versus  the  39  stimuli  variables  connected  with  media  in  the  left 
column.  A  "1"  has  been  entered  in  each  cell  where  that  particular  medium  matches 
the  corresponding  stimulus.  You  are  now  ready  to  begin  the  medium  selection 
process . 

(1)  Determine  from  Figure  III -4,  Coding  Sheet,  which  of  the  num¬ 
bered  stimulus  variables  you  have  decided  are  relevant  to  the  task  (or  grouping 


TRAINING  EQUIPMENT  A  MATERIALS 


1 1 1—5 .  Tr  r.ir.g  Equipment  and  Materials  versus  Stimuli  Variables 


3 


aaBWBBHBI 

SaaniSBHi 


iHiBBiiiMSB^Blg— HMMI 


BumiiBHaiBiaiupni 


i^HHBBeaaasaarjauaai 


Q.XN03  saiavrwA  nnwus 


m  «r  &*mmm  ■ 


«>55  ”  ■  • 


:ii-i 


Training  Equipment  and  Materials  Versus  Stimuli  Variables  (continued) 


of  similar  tasks).  In  this  example,  they  were  1,  8,  9,  10,  14,  1 8 ,  22,  24,  33, 
35 ,  36 ,  and  38  ( see  paragraph  b  above) .  These  rows  have  been  shaded  on  Figure 
III-5  for  convenience.  The  cells  in  these  shaded  rows  are  the  only  ones  you 
are  concerned  with  in  this  example. 

(2)  For  each  column,  sum  the  cells  of  concern  in  which  there  is 
a  "1."  These  sums  are  shown  at  (a)  at  the  bottom  of  matrix.  These  sums  re¬ 
flect  how  well  each  device  fits  the  conditions  of  the  stimuli  variables  of  the 
task.*  The  pieces  of  equipment  showing  the  "best  fit"  are  carrel  (19),  dial 
access  information  retrieval  system  -  audio/visual  (20),  and  computer  (32). 
Because  only  a  single  task  has  been  used  in  this  example,  more  than  one  piece 
of  equipment  shows  a  "best  fit."  However,  if  more  tasks  had  been  used,  the 
selection  process  would  have  narrowed  down  the  number  of  "best  fit"  pieces  of 
equipment.  If  there  are  a  number  of  "best  fit"  pieces  cf  equipment,  however, 
the  piece  that  costs  the  least  would  be  the  one  selected.  Complete  descriptions 
of  the  three  devices  selected  can  be  found  in  Appendix  5. 

(3)  Figure  III-6  is  the  corresponding  matrix  for  the  response 
variables  showing  across  the  top  the  number  of  the  38  items  of  training  equip¬ 
ment  and  materials  versus  the  number  of  the  16  response  variables  in  the  left 
column.  As  with  the  stimulus  variables,  determine  from  Figure  III-4,  Coding 
Sheet,  which  of  the  numbered  response  variables  you  have  decided  are  relevant 
to  the  task  (or  task  grouping).  In  the  example,  these  are  3,  6,  9,  12,  13, 
and  15  (see  paragraph  b  above).  These  rows  have  been  shaded  on  Figure  III-6. 

The  result  of  the  summing  of  the  appropriate  cells  is  shown  in  row  (b)  at  the 
bottom  of  the  matrix.*  The  largest  value  in  the  row  is  6,  which  corresponds 
to  carrels  (19),  demonstrators  (33),  mock-up  and  panel  (34),  and  operational 
equipment  (35).  The  description  for  each  device  can  again  be  found  in  Appendix 
5. 

(4)  Finally,  perform  the  same  operations  for  the  feedback  vari¬ 
ables.  Figure  III-7  is  the  matrix  with  the  39  items  of  training  equipment  and 
materials  across  the  top  and  the  17  feedback  variables  in  the  left  column.  The 
feedback  variables  of  interest  (from  Figure  III-4,  Coding  Sheet)  were  determined 
to  be  3,  10,  14,  15,  and  16  (shaded  in  Figure  III-7).  The  result  of  summing  is 
shown  in  row  (c)  at  the  bottom  of  the  matrix.*  The  "best  fit"  media  are  com¬ 
puter  (32)  and  operational  equipment  (35). 

(5)  Now  the  method  can  be  selected.  Figure  III-8  is  a  matrix 
with  23  methods  across  the  top  and  13  functional  context  variables  in  the  left 
column.  From  Figure  III-4 ,  you  have  determined  for  this  example  that  the  func¬ 
tional  context  variables  3,  4,  5,  6,  9,  10,  and  12  are  relevant  to  this  task. 

The  results  of  summing  the  appropriate  cells  for  the  example  are  in  row  (d)  at 


•If  you  can  weight  the  difference  in  importance  of  the  stimuli  variables,  then 
you  must  multiply  each  "1"  in  those  ceils  of  interest  by  your  appropriate 
weighting  before  summing  each  column. 

•Again,  as  for  tne  stimulus  variables  matrix,  if  you  can  weight  the  importance 
of  these  response  variables,  you  would  multiply  each  applicable  "1"  by  the 
corresponding  weight. 


Figure  III-6.  Training  Equipment  and  Materials  Versus  Response  Variables 
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the  bottom  of  the  matrix.*  The  method  selected  is  tutoring  (13).  A  description 
of  each  method  is  at  Appendix  6. 

g.  For  this  example,  the  complete  package  would  probably  consist  of 
a  carrel  for  a  stimulus  presentation  device,  carrel  for  a  response  acceptance 
device,  and  a  computer  for  a  feedback  evaluation  device.  The  "best  fit"  method 
would  be  tutoring.  If  "instructor"  had  been  included  as  a  type  of  media  in  the 
selection  matrices  for  media,  the  probability  that  an  instructor  would  have  been 
chosen  over  a  computer  for  feedback  evaluation  is  high,  since  he/she  probably 
costs  less  and  is  much  more  flexible.  In  addition,  an  instructor  would  fit  well 
with  the  tutorial  method  selected. 

Only  one  task  at  a  time  has  been  considered  in  the  selection  of 
method  and  stimulus,  response,  and  feedback  equipment.  If  several  tasks  had 
been  used,  there  would  have  been  three  vectors  of  sums  for  each  media  subprocess. 
Each  one  would  have  been  grouped  in  a  matrix  and  would  have  been  subjected  to 
the  procedure  that  generates  the  efficiency  ratios  to  be  covered  in  paragraph  C. 

A  number  of  equipment  choices  would  have  thus  been  generated,  but  when  a  small 
number  of  related  tasks  is  considered,  the  result  is  a  single  piece  of  equipment. 

2.  TECEP  (Eraby  et  al, ,  A  Technique  for  Choosing  Cost-Effective 

Instructional  {Delivery  Systems,  TA£6  Report  No.  1b,  19?5) 

Of  all  available  analytical  methods  with  potential  applications  to 
CTEA,  this  one  appears  to  be  the  one  most  consistent  with  current  ISD  procedures 
(TRADOC  Pamphlet  350-30).  The  ISD  procedures,  in  Block  III .  1 ,  employ  the  same 
learning  guidelines  and  algorithms  (for  twelve  types  of  training  objectives)  on 
which  this  method  is  based.  The  TAEG  method  is  called  Training  Effectiveness , 
Cost  Effectiveness  Prediction  technique  (TECEP) ,  and  it  is  intended  for  use 
during  the  conceptual  phase  of  training  program  development.* 

The  TECEP  technique  begins  with  a  list  of  training  cojectives.  If 
these  are  not  available,  they  must  le  generated.  Each  training  objective  in 
the  proposed  training  system  is  matched  with  the  category  of  learning  or  learn¬ 
ing  algorithm  of  which  twelve  are  given.  These  are  reproduced  in  Table  B-1-1 
of  Appendix  1  to  Annex  B  with  the  characteristics  of  training  objectives  that 
can  be  accomplished  with  them. 

a.  Make  a  tentative  classification  by  checking  the  learning  objective 
against  the  information  given  for  each  category  and  decide  in  which  it  fits 


*See  previous  notes  for  stimulus  and  response  variables  regarding  weighting. 
This  is  applicable  here,  also. 

*The  procedures  herein  have  been  taken  from  or  adapted  from: 

a.  Braby  et  al . ,  Training  Analysis  and  Evaluation  Group,  A  Technique  for 
Chocsing  Cost-Effective  Instructional  Delivery  Systems,  TAEG  Report  No.  16 , 
Orlando^  April  i?75. 

b.  DA  TF.AX'C  Pamphlet  35C-30,  Interservice  Procedures  for  Instructional 
Systems  Development,  Phase  III,  Develop,  i  August  1975  (much  of  which  was 
adapted  from  TAEG  manuscripts) . 
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best.  Compare  the  characteristics  of  the  training  objective  with  the  action 
verbs,  behavioral  attributes,  and  examples  of  objectives  as  listed  in  the 
table . 


If  you  have  difficulty  fitting  a  learning  objective  into  a  single  cate¬ 
gory  because  it  seems  to  fit  equally  well  in  several,  the  learning  objective 
may  not  be  specific  or  clear,  the  action  required  may  be  two  or  more  objectives 
or  it  may  have  other  faults.  If  creating  two  or  more  objectives  is  not  feasi¬ 
ble,  decide  what  in  the  objective  will  require  the  most  instruction.  Place 
the  objective  in  that  category. 

EXAMPLE 

The  learning  objective  might  be  "Paint  barracks  when 
painting  is  needed."  Applying  the  paint  is  a  repetitive 
mechanical  skill,  and  the  objective  fits  "performing  gross 
motor  skills."  However,  knowing  when  painting  is  needed 
requires  choosing  a  course  of  action  based  on  applying 
known  rules,  and  the  objective  also  fits  "rule  learning  and 
using."  Divide  the  original  objective  into  two  new  ones: 

"Paint  the  barracks,"  and  "Identify  that  barracks  needs 
painting." 

Group  the  training  objectives  into  sets  that  are  classified  alike. 

b.  Appendix  2  tc  Annex  B  contains  an  Instructional  Delivery  System 
Chart  for  each  category  of  learning  or  learning  algorithm  discussed  in  Appendix 
1.  For  each  group  or  set  of  training  objectives: 

(1)  Select  the  Instructional  Delivery  System  Chart  corresponding 
to  the  learning  algorithms  of  that  set.  The  chart  for  the  algorithm.  Recalling 
Procedures  and  Positioning  Movement,  is  provided  as  Figure  III-9.  Note  that  the 
columns  headed  Alternative  Instructional  Delivery  Systems  are  divided  into  two 
sections;  i.e.,  those  permitting  the  full  use  of  the  algorithm  and  those  not 
permitting  full  use.  The  latter  group  includes  some  existing  or  traditional 
practices  that  are  considered  to  be  less  powerful  or  efficient  than  those  en¬ 
abling  the  full  use  of  the  algorithm.  The  analyst  may  wish  to  add  additional 
approaches  to  either  side  of  the  chart. 

(2)  Each  of  the  learning  activities  now  must  be  translated  into 
applicable  stimulus  criteria.  The  possible  stimulus  criteria  are  listed  in  the 
left  column  of  the  selection  chart.  If  the  activity  involves  sound  alone,  con¬ 
sider  the  choices  under  audio  stimuli.  If  the  activity  involves  visual  stimuli, 
specify  which  visuals  are  needed.  For  each  stimulus  criteria  applicable  to  the 
selected  learning  activities,  put  a  check  mark  after  the  appropriate  stimulus 
criteria  on  the  worksheet.  These  are  very  important  because  they  will  be  the 
basis  for  selecting  the  pool  of  media  mixes.  Required  stimulus  criteria  are 
chose  basic  qualities  or  capabilities  of  a  medium  (such  as  visual  images,  motion, 
color,  and  sound)  that  sure  required  to  carry  out  the  intent  of  a  learning  acti¬ 
vity.  These  required  stimulus  criteria  can  be  specified  by  types  of  stimulus 
inherent  in  the  learning  activity,  the  student  response,  and  performance  feed¬ 
back  demands  of  the  learning  activity. 
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A  media  alternative  is  a  form  of  instructional  material  that  con¬ 
tains  the  stimulus  criterion  required  by  a  specific  learning  activity.  Identi¬ 
fication  of  media  alternatives  is  done  by  selecting  those  media  within  the 
learning  category  that  meet  the  required  stimulus  criteria.  These  become  candi¬ 
dates  for  possible  use  as  part  of  the  final  delivery  system. 

(3)  Along  the  left  side  of  the  chart  also  are  listed  requirements 
of  the  training  setting,  and  certain  administrative  and  budgetary  constraints 
unique  to  the  specific  instructional  program. 

A  blank  colimn,  with  the  heading  "Directions"  appears  on  the  chart 
immediately  to  the  right  of  the  criteria  list.  To  use  the  chart,  place  a  light 
check  in  pencil  in  those  cells  designating  criteria  that  must  be  satisfied  by 
the  delivery  system.  Then  determine  which  delivery  systems  meet  all  these 
special  criteria. 

This  part  of  the  procedure  has  been  carried  out  in  Figure  III-9 . 
Note  the  criteria  that  were  checked  as  being  essential  to  the  training  program 
for  this  objective.  Also  note  that  only  the  circled  delivery  systems  met  all 
the  special  criteria.  Two  permit  the  full  algorithm  to  be  used,  and  one  does 
not  support  the  full  use  of  the  algorithm.  The  two  tentatively  reconmended 
alternatives  are: 

(a)  Microfiche  with  or  without  Photo  or  Operable  Mock-up. 

(b)  Progranmed  Text-Branching 

c.  Each  item  remaining  in  the  list  of  media  should  be  evaluated  in 
terms  of  the  practicality  of  its  use  in  the  specific  training  system.  Reject 
those  media  that  are  impractical.  The  media  types  that  remain  are  considered 
to  be  candidates  for  use  in  the  proposed  system,  and  will  be  subjected  to  a  cost 
analysis.  Some  of  the  factors  that  may  be  important  in  rejecting  media  types 
are: 


(1)  Marginal  Technical  Solutions:  The  learning  guidelines  cannot 
be  easily  carried  out  with  the  medium. 

(2)  State-of-the-Art :  The  basic  medium  is  under  development  or 
test  and  may  not  be  available  for  practical  application  by  the  time  it  is 
required . 


(3)  Size  of  System:  Some  media  are  useful  within  large  training 
programs,  others  are  suited  only  for  small  programs,  and  therefore  may  not  be 
suited  to  the  size  program  being  considered. 

(4)  Interface  with  Existing  Program:  Many  new  courses  must  be 
designed  to  fit  into  existing  programs,  which  places  constraints  on  the  new 
courses;  e.g.,  equipment  on  hand,  available  classrooms,  scheduling  practices, 
etc. 


(5)  Time  to  Produce  Media:  Media  which  require  long  lead  times 
for  development  may  not  be  useful  when  scheduled  ready-fcr-training  dates  do 
not  allow  a  long  development  cycle. 


(6)  Budget  Cycle  Constraints:  While  the  application  of  some  of 
the  powerful  training  approaches,  such  as  CCTV  (closed  circuit  television), 
may  result  in  low  costs  per  student  graduate,  the  initial  investment  is  sub¬ 
stantial.  Unless  these  resources  appear  in  existing  budgets,  the  application 
of  these  techniques  to  an  immediate  problem  is  not  feasible. 

(7)  Adoption  of  Innovations:  Project  team  members  frequently 
resist  innovations.  If  the  proposed  media  is  significantly  different  from  ex¬ 
isting  techniques,  either  adequate  resources  must  be  focused  upon  gaining  accep¬ 
tance  for  the  innovation,  or  a  more  traditional  approach  must  be  selected. 

(9)  Courseware  Development:  If  the  courseware  is  to  be  locally 
developed,  skilled  personnel,  equipment,  time,  and  dollars  must  be  available. 

(9)  High  Cost  Alternatives:  The  projected  life  cycle  cost  of  a 
media  approach  may  be  significantly  higher  than  other  equally  useful  alterna¬ 
tives.  Reject  high  cost  alternatives. 

(10)  Learning  Style  of  Trainees:  If  trainee  has  low  reading 
ability  or  would  be  limited  in  his  ability  to  use  certain  kinds  of  media,  then 
reject  these  media  as  inappropriate. 

(11)  Other  Constraints:  A  variety  of  other  practical  factors 
should  be  considered;  e.g.,  coranand  policy  and  existing  investment  in  production 
facilities . 

In  the  case  cf  the  sample  problem  ( Figure  III-9 ) ,  the  approach  re¬ 
quiring  the  use  of  programmed  text-branching  is  found  to  be  a  practical  solution 
with  some  risk  associated  with  "learning  style  of  trainees".  No  other  problems 
were  identified  by  considering  each  criterion  in  the  practicality  test.  During 
consideration  cf  the  microfiche-based  approach,  however,  a  lew  degree  of  risk 
was  identified  for  two  items.  The  first  low  risk  area  concerned  test  item  Num¬ 
ber  2,  the  "state-of-the-art."  Studies  involving  the  use  of  color  microfiche 
in  procedure- following  training  have  not  been  conducted  within  the  Department 
of  Defense.  However,  applications  in  industry  have  been  successful.  Some  risk, 
however,  is  associated  with  the  initial  applications  of  colored  microfiche  in 
the  military  environment.  The  second  low  risk  area  concerned  test  item  Number 
8,  "courseware  development . "  It  is  assumed  that  the  team  developing  courseware 
will  have  no  experience  in  developing  microfiche-based  courseware.  This  lack  of 
experience  is  not  considered  to  be  a  serious  problem.  Skills  required  would  be 
similar  to  those  used  in  writing  programmed  texts  and  making  slide  sets.  The 
reproduction  of  the  color  microfiche  would  be  accomplished  by  a  commercial 
laboratory. 

Both  instructional  delivery  systems  survived  the  practicality  test 
and  are  considered  to  be  candidates  for  use  in  the  proposed  training  system. 

3.  DIVAP  Gun 

Given  a  "generic"  task  list  as  generated  in  paragraph  A1  above  (page 
III-1),  you  must  again  rely  on  your  subject  matter  expertise  and  good  judgment 
or  find  an  5ME  to  help  you  develop  training  alternatives.  For  example,  in  the 
DIVAD  Gun  CTEA,  the  analyst  was  an  SME  and  had  some  familiarity  with  the  DIVAD 


Gun  and  training  device  configurations  and  capabilities.  He  formulated  the 
following  three  alternatives: 

a.  Training  conducted  with  operational  equipment  only. 

b.  Training  conducted  with  reduced  operational  equipment 
augmented  by  the  classroom  trainer. 

c.  Training  conducted  with  further  reduced  operational 
equipment  augmented  by  both  the  classroom  trainer  and 
the  maintenance  trainer. 

As  with  the  generation  of  the  "generic”  task  list,  this  method  is  a 
last  resort  when  "something  is  better  than  nothing"  and  is  based  totally  on 
previous  experience. 

4.  Analogous  Task  Method 

Having  generated  a  task  list  by  any  of  the  methods  in  A  above  (see 
pages  III-1  to  III-6),  you  must  now  locate  a  training  yardstick  against  which  a 
proposed  training  plan  can  be  evaluated.  The  yardstick  should  provide  you  with 
the  ability  to  predict  the  level  of  success  of  the  training  plan,  to  diagnose 
those  parts  likely  to  be  problematic,  and  to  prescribe  alternative  components 
for  these  parts.  Since  training  will  be  given  on  a  task  by  task  basis,  the  yard¬ 
stick  must  be  ir.  reality  many  yardsticks,  one  for  each  task.  To  fulfill  the 
three  purposes  of  prediction,  diagnosis,  and  prescription,  detailed  training 
information  is  required. 

One  likely  source  of  such  information  is  the  training  being  done  for 
tasks  on  fielded  systems.  The  training  on  a  fielded  system  has  usually  been 
used,  tested,  and  modified.  It  can  therefore  serve  as  a  working  model  of  train¬ 
ing  for  the  system  in  development  and  as  a  source  of  evaluative  data  on  the 
effectiveness  of  training.  The  central  difficulty  in  using  this  training  infor¬ 
mation  is  the  necessity  to  decide  which  task  on  one  or  more  fielded  systems  most 
closely  approximates  the  task  whose  training  is  being  predicted.  “The  problem  is 
two- fold.  First,  you  must  define  the  criteria  by  which  you  will  decide  whether 
a  fielded  task  is  similar  or  analogous.  Second  you  must  locate  analogous  tasks. 
Remember  that  your  concern,  especially  in  the  early  stages  of  development,  should 
be  focused  on  the  form  of  training  (the  training  approach,  the  training  resources 
needed,  etc.)  rather  than  the  content  of  training.  Tasks  which  are  sufficiently 
different  so  that  the  content  of  the  training  is  of  little  use  may  still  provide 
valuable  information  about  the  appropriate  form  of  training. 

a.  Task  Classification 

(1)  Classify  the  target  task  by: 

o  the  action  verb  in  the  task  description, 

o  the  body  of  knowledge  the  soldier  must  understand  as 
general  background  to  task  performance, 

o  the  stimuli  provided  by  the  equipment  (or  external 
source)  to  initiate  the  tasx, 
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o  the  response  made  to  the  stimuli, 

o  the  feedback  provided  to  indicate  proper  or  improper 
performance  of  the  task. 

(2)  Determine  the  task  type  by  the  action  verb  and  the  knowledge 
context  for  each  task.  The  knowledge  or  task  context  is  the  general  nature  of 
the  equipment  and  the  action  performed  with  it.  For  some  tasks,  the  context 
will  be  explicit  in  the  task  verb.  For  example,  "Fly”  is  a  task  performed  with 
aircraft  (or  missiles).  For  other  tasks,  the  action  occurs  in  a  variety  of  con¬ 
texts.  Therefore,  you  must  derive  the  context  from  the  task  description  as  a 
whole.  "Troubleshoot,"  for  example,  is  an  action  performed  with  electrical, 
electronic,  automotive,  and  mechanical  equipment,  among  others.  The  subtasks 
and  task  elements  of  "Troubleshoot"  in  these  various  contexts  will  be  very  dif¬ 
ferent.  Not  ail  tasks  have  a  specific  context.  You  may  find  tasks  for  which  a 
context  is  net  important.  That  is,  the  task  requires  the  same  action  regardless 
of  the  nature  of  the  equipment  on  which  it  is  performed. 

The  types  of  actions  fall  into  15  major  categories: 

o  1 .  Selecting  and  using  roles 
o  2.  Making  decisions 
o  3.  Solving  problems 
o  4 .  Monitoring 

o  5.  Classifying  perceptual,  nonrgraphic  signals 
o  6.  Identifying  graphic  symbols 
o  7.  Communicating  by  voice^  2 

o  8.  Communicating  by  writing  or  typing^  2 

o  9.  Communicating  non-verbally  (signaling)^ 

o  10.  Following  procedures 
o  11.  Positioning  movements 
o  12.  Discrete  regulatory  movements 
o  13.  Continuous  regulatory  movements 
o  14.  Performing  complex  skills 
o  15.  Gross  motor  movement 

Compare  the  action  verb  with  those  in  the  task  verb  list 
(Appendix  1  of  Annex  C).  The  list  gives  the  task  type  to  which  each  verb  mean¬ 
ing  has  been  assigned.  If  the  verb  does  not  appear  in  the  task  verb  list,  com¬ 
pare  the  verb  with  the  descriptions  and  examples  of  each  type  that  appear  in 


Many  action  verbs  indicating  the  process  of  classifying  are  independent  of 
the  object  classified.  These  verbs  are  appropriate  for  both  categories  5  and 
6.  To  classify  a  particular  task  when  these  verbs  are  used,  you  must  also 
determine  the  nature  of  the  classified  object. 

^Many  action  verbs  indicate  the  process  of  information  transfer  without  re¬ 
ference  to  the  means  of  transfer.  These  verbs  are  appropriate  to  both 
categories  ?  and  8.  These  verbs  may  also  be  appropriate  to  category  9  al¬ 
though  signaling  is  not  usually  appropriate  to  the  communication  of  iarge 
quantities  of  information  or  fine  detail.  To  classify  a  particular  task 
wnen  these  verbs  are  used,  you  must  also  determine  the  conmunication  process. 
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the  synonym  list  (Appendix  2  to  Annex  C).  The  verb  may  be  an  unlisted  synonym 
for  one  of  the  verbs  in  the  synonym  list.  If  not,  assign  the  verb  to  that  cate¬ 
gory  which  most  closely  describes  it. 

(3)  Determine  the  type  of  initiating  cue  or  stimului.f’iThe  ini¬ 
tiating  cue  which  indicates  that  a  task  should  begin  can  be  classified  as  vis¬ 
ual,  auditory,  tactile,  body  motion,  limb  motion,  olfactory,  or  gustatory. 

These  are  defined  in  Table  III-1.  The  characteristics  of  the  cue  can  be  classi¬ 
fied  along  several  dimensions .  Some  of  these  dimensions  are  general.  That  is, 
cues  in  all  of  the  categories  can  be  classified  along  these  dimensions.  The 
dimensions,  defined  in  Table  III-2  are  the  likelihood  that  the  cue  will  occur 
during  a  mission,  the  rate  at  which  the  cue  will  occur,  the  intensity  or  contrast 
of  the  cue  with  respect  to  the  background,  and  the  presence  of  other  cues  com¬ 
peting  for  attention.  In  addition,  there  are  dimensions  specific  to  cues  in 

the  visual  and  auditory  categories.  Visual  cues  are  classified  by  their  form, 
movement,  and  color;  auditory  cues,  by  their  pattern,  range,  and  pitch.  The 
visual  dimensions  are  defined  in  Table  III-3  and  the  auditory  dimensions,  in 
Table  111-4. 

The  initiating  cue  for  a  task  may  have  components  in  more 
than  one  category.  However,  each  component  will  have  only  one  characteristic 
value  along  each  of  the  dimensions.  For  example,  the  cue  may  have  visual  (1) 
ana  tactile  (3)  components.  The  tactile  component  may  be  likely  to  occur 
(0.1.2),  but  only  once  (0.2.1),  it  may  be  high  in  contrast  (0.3.2)  and  occur 
when  other  cues  do  not  (0.4.1).  The  visual  component  may  be  low  in  contrast 
(0.3.1)  with  the  ether  three  characteristics  the  same  as  for  the  tactile  com¬ 
ponent.  In  addition,  the  visual  component  may  be  alphanumeric  (1.5.2),  still 
(1.6.1),  and  black  and  white  (1.7.1).  Note  that  the  visual  component  can  be 
low  in  contrast  while  the  tactile  component  is  high,  but  the  visual  component 
cannot  be  both  low  and  high  in  contrast  itself. 

(4)  Determine  the  type  of  response  to  the  stimulus.  The  response 
completing  the  task  can  be  classified  as  verbal,  written,  manipulative  or  exer- 
tive  (see  Table  III-5).  The  responses  in  all  categories  can  be  assessed  as  to 
the  pattern  and  required  rate  of  response,  the  effort  necessary  to  make  the  re¬ 
sponse,  the  presence  of  competing  responses,  and  the  allowable  flexibility  of 
response.  The  specific  values  distinguished  along  these  dimensions  are  defined 
in  Table  III-6.  As  with  the  cues,  the  responses  can  have  components  in  more 
than  one  category  but  each  component  will  have  only  one  characteristic  value 
along  each  of  the  dimensions. 

Note  that  to  classify  a  response  as  exertive  does  not  mean 
that  the  amount  of  effort  expended  is  high  nor  must  a  manipulative  action  be 
low  in  effort.  Pushing  a  cart  (exertive),  for  example,  may  require  little  ef¬ 
fort  while  positioning  a  lever  (manipulative)  may  require  much  effort.  You  may 
have  difficulty  classifying  responses  in  which  a  force  is  applied  to  position 
an  object.  It  may  be  helpful  to  focus  on  the  basic  nature  of  the  response.  If 
the  response  is  concerned  with  movement,  then  the  response  is  exertive;  if  the 
response  is  concerned  with  final  position  and  the  movement  is  secondary,  then 
the  response  is  manipulative. 


TABLE  III-1 


Categories  of  Initiating  Cues 


1.  Visual  cues  -  signals  received  through  the  sense  of  sight. 

2.  Auditory  cues  -  signals  received  through  the  sense  of  hearing. 

3.  Tactile  cues  -  signals  received  through  the  sense  of  touch,  including  cues 
from  the  texture,  size,  or  shape  of  an  object  and  from  vibration  on  the 
skin. 

4.  Body  Motion  cues  -  signals  received  through  sense  of  equilibrium,  including 
cues  from  external  forces  that  cause  the  body  to  roll,  pitch,  yaw,  heave, 
sway  and/or’  surge. 

5.  Limb  Motion  cues  -  signals  received  through  the  proprioceptive  sense,  such 

as  are  felt  when  the  arms,  legs,  fingers,  etc.,  are  moved. 

b.  Olfactory  cues  -  signals  received  through  the  sense  of  smell. 

7.  Gustatory  cues  -  signals  received  through  the  sense  of  taste. 
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TABLE  III-2 


General  Dimensions  of  Cue  Characteristics 


0.1  Cue  Likelihood 


0.1.1 

Unlikely 

Cue  is  not  expected  by  the  operator  or  maintenance 
personnel  because  of  low  likelihood  or  irregular 
pattern  of  occurrence. 

0.1  .2 

Likely 

Cue  is  expected  by  the  operator  or  maintenance 
personnel  because  of  previously  occurring  cues  or 
a  regular,  cyclical  occurrence  of  the  same  cue. 

0.2 

Cue  Occurrence  Rate 

0.2.1 

Single 

A  single  cue  occurs  in  the  course  of  a  mission 
(assuming  that  a  cue  does  occur). 

0.2.2 

Low  Rate 

A  slow  or  low  rate  of  occurrence  of  the  cues  through 
the  course  of  the  mission. 

0.2.3 

High  Rate 

A  fast  or  high  rate  of  occurrence  of  the  cues  through 
the  course  of  the  mission. 

0.3  ' 

Cue  Intensity  or 

Contrast 

0.3.1 

Low 

Cue  is  of  low  intensity  and  low  contrast,  i.e.,  a  sig¬ 
nal  which  blends  into  the  background  noise  of  that 
sense  and  is  therefore  difficult  to  distinguish  or 
detect. 

0.3.2 

High 

Cue  is  of  high  intensity  or  a  cue  of  high  contrast, 
i.e.,  a  signal  which  stands  out  from  the  background 
by  reason  of  higher  or  lower  intensity,  and  is  there¬ 
fore  easy  to  distinguish. 

0.4 

Cue  Competition 

0.4.1 

Low 

Cue  occurs  when  few  other  cues  or  actions  are  com¬ 
peting  for  the  attention  of  the  operator  or  main¬ 
tenance  personnel. 

0.4.2 

High 

Cue  occurs  when  other  cues  or  actions  have  the 
attention  of  the  operator  or  maintenance  personnel 
and  therefore  the  cue  may  be  missed  or  reaction  to 
the  cue  may  be  delayed. 
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TABLE  III-3 

Dimensions  of  Visual  Cue  Characteristics 


1 .5  Visual  Form 

1.5.1 

Spot 

Unitary  dots  or  flashes  of  light  (dots  in 
grids  or  other  lines  should  be  classified 
graphic  -  1 .5 .4) . 

the  context  of 
as  visual 

1.5.2 

Alphanuneric 

Words  and/or  numbers  presented  visually. 

1.5.3 

Symbolic 

Symbols  such  as  graphic  characters  not  in 

text. 

1 .5.4 

Graphic 

Two-dimensional  schematic  images,  such  as 
matnematical  curves. 

maps,  graphs,  and 

1 .5.5 

Pictorial 

Two-dimensional  images,  such  as  television  pictures,  photo¬ 
graphs,  and  drawings. 

1.5.6 

Solid  Object 

Three-dimensional  images  or  objects. 

1.5.7 

Ambient: 

Light 

Changes  in  the  general  illumination  level 
the  environment. 

in  an  enclosure  or 

1 .b  Visual  Movement 

Static  visual  images  such  as  still  photographs,  drawing;,  or 
printed  pages. 

Partially  static  visual  images  with  elements  that  move  over 
a  limited  portion  of  the  image. 

Visual  images  in  which  the  elements  move  over  the  full  ex¬ 
tent  of  the  image  but  in  a  fixed,  repetitive  sequence. 

Visual  images  in  which  all  elements  move  over  the  full  ex¬ 
tent  of  the  image  without  restriction. 


Visual  images  composed  of  black  and  white  elements,  such  as 
printed  pages  or  line  drawings  (images  with  dichotomous 
colors  such  as  brown  and  beige  printed  pages  or  green  and 
black  CRT  displays  are  classified  as  black  and  white) . 

Visual  images  composed  of  black,  white,  and  various  grada¬ 
tions  of  gray  such  as  black  and  white  photographs  and  black 
ar.d  white  television  pictures. 

Visual  images  composed  of  several  (more  than  two)  colors 
such  as  color  television  pictures  or  color  motion  pictures. 


1.6.1 

Still 

1 .6.2 

Limited 

Movement 

1 .6.3 

Cyclic 

Movement 

1.6.4 

Full 

Movement 

1.7  V: 

isual  Color 

1 .7.1 

Black  and 
White 

1 .7.2 

Half  Tone 

1.7.3 

Cclcr 
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TABLE  III-4 


Dimensions  of  Auditory  Cue  Characteristics 


2.5  Auditory  Pattern 

2.5.1  Steady  Sounds  or  noises  which  do  not  vary  in  pitch. 

2.5.2  Quavering  Sounds  or  noises  which  alternate  rapidly  between 

two  pitches. 

2.5.3  Patterned  Sounds  or  noises  which  change  pitch  in  a  cyclic  or 

patterned  way  such  as  a  melody. 

2.5.4  Irregular  Sounds  or  noises  which  change  pitch  in  an  irregular 

or  random  way. 

2.5.5  Ambient  Sound  Changes  in  the  mixture  of  sounds  and  noises  which 

form  the  auditory  background  in  an  enclosure  or  in 
the  environment. 


2.b  Auditory  Range 

2 . fc . 1  Limited  Range  Sounds  or  noises  limited  to  a  small  number  of  pitches. 

2.6.2  Voice  Range  Sounds  in  the  form  of  words  in  the  normal  range  of 

the  spoken  voice. 

2.6.3  Full  Range  Sounds  or  noises  which  vary  over  all  or  most  of  the 

audible  range. 


2.7  Auditory  Pitch 

2.7.1  Low  Sounds  or  noises  with  a  low  pitch  (frequency). 

2.7.2  High  Sounds  or  noises  with  a  high  pitch  (frequency). 
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TABLE  III-5 


Categories  of  Responses 


1.  Verbal  responses  -  responses  delivered  in  an  audible  spoken  message,  with 
words  from  a  small,  stylized  set  or  freely  chosen. 

2.  Written  responses  -  responses  delivered  in  a  written  message,  with  words 
from  a  small,  stylized  set  or  freely  chosen,  or  by  checking  a  previously 
written  response  on  a  form. 

3.  Manipulative  responses  -  responses  delivered  by  positioning  dials,  controls, 
switches,  keys,  levers,  or  wheels,  or  positioning  of  hand-held  tools. 

4 .  Exertive  responses  -  responses  delivered  by  the  application  'of  force  to 
an  object  or  tool  with  the  hand,  foot,  or  body. 


TABLE  III-6 

Dimensions  of  Response  Characteristics 


0.1  Response  Pattern 

0.1.1 

Single  Action 

A  single  action  is  necessary  to  accomplish  the  task. 

0.1 .2 

Repeated 

Action 

A  single  action  performed  repeatedly  is  necessary  to 
accomplish  the  task. 

0.1.3 

Non-Oraered 

Action 

A  fixed  set  of  actions  is  necessary  to  accomplish  the  task 
but  the  order  of  performance  is  not  important. 

0.1 .4 

Procedure 

A  fixed  set  of  actions  performed  in  a  specified  order  is 
necessary  to  accomplish  the  task. 

0.1 .5 

Continuous 

Regulation 

A  variable  set  of  actions  is  necessary  to  continuously 
maintain  control  or  guide  a  changing  system  such  as  to 
steer  an  automobile. 

0.2  Required  Rate  of  Response 

0.2.1  Slow  Rate  For  a  single  action  (0.1.1),  the  time  between  cue  and  re¬ 

sponse  may  be  long,  i.e.,  the  response  need  not  be  imme¬ 
diate.  For  a  series  of  actions  (0.1 .2-0.1 .5) ,  the  rate  at 
which  successive  actions  are  performed  may  be  slow. 

0.2.2  Fast  Rate  For  a  single  action  (0.1.1),  the  time  between  cue  and  re¬ 

sponse  must  be  short,  i.e.,  the  response  must  be  immediate. 
For  a  series  of  actions  (0.1 .2-0.1 .5) ,  the  rate  at  which 
successive  actions  are  performed  must  be  rapid. 


0.3  Required  Response  Effort 

0.3.1  Low  The  effort  required  to  perform  the  response  is  small. 

0.3.2  High  The  effort  required  to  perform  the  response  is  large. 

0.4  Response  Competition 

0.4.1  Low  Response  is  made  when  few  other  actions  or  cues  are  competing 

for  the  attention  of  the  operator  or  maintenance  personnel. 

0.4.2  High  Response  is  made  when  other  responses  or  cues  are  competing 

for  the  attention  of  the  operator  or  maintenance  personnel. 


0.5  Response  Flexibility 


0.5.1  None 


Only  a  specific  response  or  set  of  responses  can  accomplish 
the  task. 


0.5.2  Some 


Any  of  a  number  of  responses  or  sets  of  responses  will 
accomplish  the  task. 
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Note  also  that  the  task  category  does  not  necessarily  imply 
the  response  category.  Performing  gross  motor  skills  (15)  and  communicating  by 
voice  (7)  are  likely  to  have  responses  in  the  exertive  (4)  and  verbal  (1)  re¬ 
sponse  categories  respectively.  However,  steering  and  guiding  (13)  tasks  may 
require  responses  in  either  the  manipulative  (3)  or  exertive  (4)  category  while 
responses  for  procedural  ( 1 6 )  tasks  may  be  in  any  of  the  response  categories. 
Perceptual  and  mental  tasks  (1-6)  may  also  require  responses  in  any  of  the  re¬ 
sponse  categories. 

(5)  Classifying  the  feedback  which  indicates  response  accuracy  and 
task  completion  is  also  an  essential  component  of  task  classifications.  The 
categories  of  feedback  are  visual,  written,  auditory,  verbal,  tactile,  kinesthe¬ 
tic,  olfactory,  and  gustatory.  The  categories,  defined  in  Table  III-7,  are 
quite  similar  to  the  categories  of  initiating  cues.  They  differ  on  two  points. 
First,  the  importance  of  language  use  in  feedback  is  recognized  by  distinguishing 
classes  of  visual  and  auditory  feedback  (written  and  verbal,  respectively)  which 
are  exclusively  based  on  language  and  making  them  separate  categories.  Second, 
the  distinction  between  body  motion  and  limb  motion  is  less  important  in  feed¬ 
back  and  they  have  been  grouped  into  a  single,  kinesthetic  category.  Feedback 
in  all  categories  should  be  judged  as  to  information  content,  source,  and  timing. 
The  values  to  be  distinguished  along  these  three  dimensions  Eire  defined  in  Table 
III. 8. 


It  may  be  tempting  to  end  the  search  for  analogous  tasks  as 
soon  as  the  first  minimally  acceptable  one  is  located.  Remember  that  the  accu¬ 
racy  of  the  training  estimates  (derived  from  the  analogous  tasks)  is  directly 
related  to  the  similarity  of  the  tasks.  Therefore  it  is  clearly  advantageous 
to  continue  the  search  for  an  analogous  task  until  a  close  match  is  identified. 
This  is  not  to  say  that  an  open  ended  search  for  the  "perfect"  match  must  con¬ 
tinue.  A  middle  ground  approach,  however,  will  pay  dividends. 

In  comparing  multiple  analogous  tasks  apply  the  remaining 
criteria  in  the  order  given.  That  is,  first  compare  the  specific  task  verbs. 
Only  if  the  task  verbs  are  the  same  should  you  apply  the  next  criterion,  stimu¬ 
lus  type.  You  should  consider  any  synonyms  identified  directly  in  the  Category/ 
Synonym  List  in  Appendix  2,  as  equivalent  to  identical  task  verbs.  As  with  the 
response,  correspondence  on  stimulus  means  agreement  both  as  to  category  and 
value  of  characteristics  on  the  dimensions  analyzed.  As  above,  only  if  the 
tasks  correspond  on  stimulus  should  you  consider  the  specific  response,  and 
necessary  conditions,  and  feedback. 

Table  III-9  is  a  hypothetical  example  of  the  application  of 
the  Analogous  Task  Method  for  the  prediction  of  training  programs.  It  compares 
the  target  task,  Track  on  Aerial  Target  with  two  candidate  analogous  tasks  of 
tracking  aerial  targets.  In  this  case,  you  can  see  there  is  complete  corre¬ 
spondence  until  you  come  to  feedback  (Table  III-7).  This  indicates  that  you 
may  want  to  retain  both  candidates  in  order  to  have  alternative  training  pro¬ 
grams.  The  training  program  for  analogous  task  number  2  may  be  more  effective 
than  number  1  when  it  is  modified  to  compensate  for  the  feedback  variation. 
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TABLE  III-7 

Categories  of  Feedback  Information 


1 .  Visual  feedback  -  information  presented  through  the  sense  of  sight  with  the 
exception  of  written  messages  and  texts. 

2.  Written  feedback  -  information  presented  through  the  sense  of  sight  by 
means  of  words  and/or  nunbers,  written,  printed,  or  displayed  in  the  form 
of  a  message  or  text. 

3.  Auditory  feedback  -  information  presented  through  the  sense  of  hearing  with 
the  exception  of  spoken  messages  and  texts. 

4.  Verbal  feedback  -  information  presented  through  the  sense  of  hearing  by 
means  of  words  spoken  directly  or  transmitted  by  eonmuni cations  equipment. 

5.  Tactile  feedback  -  information  presented  through  the  sense  of  touch,  in¬ 
cluding  information  about  the  texture,  size,  or  shape  of  an  object  and 
vibrations  on  the  skin. 

b.  Kinesthetic  feedback  -  information  presented  by  means  of  body  or  limb  motion 
either  through  the  sense  of  equilibrium  or  the  proprioceptive  sense. 

7.  Olfactory  feedback  -  information  presented  through  the  sense  of  smell. 

d.  Gustatory  feedback  -  information  presented  through  the  sense  of  taste. 


TABLE  III-8 


Dimensions  of  Feedback  Characteristics 


0.1  Feedback  Information  Content 

0.1.1  None  No  feedback  given . 

0.1.2  Response  Feedback  indicates  whether  or  not  a  response  was  made 

Execution  and  registered  by  the  equipment  but  does  not  indicate 

whether  or  not  the  response  was  correct. 

Feedback  indicates  the  general  status  of  the  system 
and/or  its  environment.  Changes  in  system  status  from 
previous  reports  may  reflect  the  consequences  of  the 
response  made  and/or  independent  changes  in  the  sys¬ 
tem  (environment).  If  the  effect  of  the  correct  re¬ 
sponse  on  the  system  (environment)  is  known,  the 
correctness  of  the  response  may  be  inferred  from  the 
status  report . 

0.1.4  Response  Feedback  indicates  both  the  status  of  the  system 

Execution/  and/or  its  environment  and  the  performance  of  a 
System  Status  response. 

0.1.5  Response  Feedback  indicates  directly  whether  or  not  a  response 

Correctness  was  correct.  Feedback  about  response  correctness 
confirms  that  a  response  was  made  and  makes  system 
status  information  superfluous  as  feedback. 


0.2  Feedback  Source 

0.2.1  Intrinsic  Feedback  is  provided  automatically  by  the  system  or  is 

obvious  from  the  effect  of  the  response  on  the  system 
or  its  environment. 

0.2.2  Extrinsic  Feedback  that  is  provided  by  the  system  only  when  re¬ 

quested  by  the  operator  or  maintenance  personnel. 


0.3  Feedback  Timing 

0.3.1  Ininediate  Feedback  is  delivered  immediately  following  the 

response. 

0.3.2  Delayed  Feedback  is  delivered  at  some  prolonged  interval  after 

the  response. 
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0.1.3  System 
Status 


% 


TABLE  III-9 


TARGET  TASK:  Track  an  Aerial  Target 


Table 

Target 

Task 

Analogous 

Task  #1 

, 

Analogous 
Task  #2 

Action  Verb 

Track 

—  .  - 

Track 

Track 

Verb  Category 

(p.  III-32) 

13 

13 

13 

III-1 

1  +  2 

1  +  2 

1  +  2 

III-2 

0.1.2 

0.1 .2 

0.1 .2 

0.2.3 

0.2.3 

0.2.3 

0.3.1 

0.3.1 

0.3.1 

0.4.2 

0.4.2 

0.4.2 

III-3 

1.5.1 

1.5.1 

1.5.1 

1.6.2 

1.6.2 

1.6.2 

1.7.1 

1.7.1 

1.7.1 

III-4 

2.5.1 

2.5.1 

1 

2.5.1 

2.6.1 

2.6.2 

j  2.6.1 

2.7.2 

2.7.2 

2.7.2 

1 

III-5 

3 

3 

.  .  .  .I 

3 

III-6 

0.1 .5 

i 

0.1.5  1 

0.1 .5 

0.2.2 

0.2.2 

0.2.2 

0.3.1 

0.3.1 

0.3.1 

0.5.1 

0.5.1 

0.5.1 

III-7 

1 

. * 

1 

3 

III-8 

0.1.4 

0.1.4 

0.1.4 

0.2.1 

0.2.1 

0.2.1 

l 

0.3.1 

0.3.1 

0.3.1 
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b.  Training  Assessment 

If  two  analogous  tastes  correspond  with  the  task  in  development  on 
all  the  criteria,  then  the  training  information  from  the  two  tasks  should  be  con¬ 
sidered  jointly.  However,  one  final  criterion  should  be  considered  first:  the 
population  of  soldiers  who  will  be  performing  the  task.  You  should  determine 
the  experience  level  (defined  as  pay  grade)  of  the  soldiers  who  will  be  opera¬ 
ting  and  maintaining  the  new  weapons  system  and  identify  which  analogous  task 
is  performed  by  soldiers  with  the  most  comparable  experience  level.  If  the 
analogous  tasks  correspond  here  too,  then  consider  both  tasks  together. 

For  each  analogous  task  identified,  obtain  the  details  of  training. 
These  details  will  be  in  the  Course  of  Instruction  (COI)  or  lesson  plans  and  the 
specifications  for  training  devices  used  in  the  training.  The  training  on  the 
analogous  task  can  be  used  as  the  training  plan  for  the  target  task  if  no  plan 
has  been  formulated.  If  there  is  a  training  plan,  then  differences  between  the 
training  plan  and  analogous  task  training  will  indicate  potential  difficulties 
in  training  to  be  watched  for  in  operational  testing. 
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C.  Estimation  of  Effectiveness 
1 .  TEEM 

TEEM,  for  the  present  at  least,  determines  effectiveness  by  manually 
recording  the  trade-offs  made  during  the  generation  of  an  estimated  training 
program.  A  computer  program  is  being  developed  to  accelerate  this  process.  You 
can  then  use  these  to  determine  the  potential  decision  cost  loss  for  the  chosen 
training  program  against  an  ideal  program  with  no  constraints.  Although  such  a 
measure  supplies  no  information  about  the  absolute  value  of  a  number  so  gener¬ 
ated,  it  does  provide  a  standard  of  comparison  for  several  training  programs 
generated  using  the  same  CTEA  method.  This  has  potential  advantages  not  only 
for  the  comparison  of  alternative  programs  for  a  given  weapon  system,  but  also 
between  systems. 

In  the  TEEM  model,  this  measure  is  referred  to  as  the  efficiency  ratio. 

It  represents  a  value  which  is  composed  of  the  efficiency  score  of  an  estimated 
program  with  real  world  constraints,  divided  by  the  efficiency  score  of  an 
idealized  program,  which  is  subject  to  no  constraints.  The  actual  value  is 
generated  in  the  following  manner. 

a.  Record  the  selection  matrix  scores  from  Section  IIIB1  (Figures 
III-5,  6,  and  7)  for  each  media  matrix  and  each  task.  (See  Figures  111-IOa, 

10b,  and  10c).  This  produces  three  matrices  of  summed  values,  where  the  rows 
correspond  to  tasks  and  the  columns  correspond  to  the  degree  of  fit  which  that 
task  had  to  each  of  the  potential  training  media  for  each  stimulus,  response, 
and  feedback  function.  Figure  III-10  shows  such  matrices  completed  only  with 
the  numbers  generated  in  our  example  (Section  IIIB1 ) .  If  the  largest  sum  in 
each  row  is  chosen  initially  for  devices,  a  large  number  of  different  equipment 
choices  is  produced,  spread  over  all  the  tasks  which  are  being  considered  in 
that  functional  group.  Thus,  for  a  sample  group  of  six  tasks  there  might  be  six 
different  media  choices  for  each  of  the  three  media  functions  or  a  total  of  18 
different  devices.  If  cost  were  no  object,  and  there  were  no  resource  or  time 
constraints,  the  ideal  choice  of  media  would  be  all  18  pieces.  The  total  of  the 
equipment  fit  scores  for  those  18  pieces  would  then  represent  a  score  of  an  ideal 
choice  without  constraints.  This,  of  course,  is  not  realistic,  since  there  are 
always  constraints  that  enter  into  any  decision.  As  these  constraints  are  ap¬ 
plied,  the  viability  of  a  particular  piece  of  equipment  for  a  particular  task 
may  change.  For  example,  even  though  it  may  not  be  an  optimal  choice,  you  may 
have  on  hand  a  particular  training  device  and  want  to  include  that  equipment  in 
the  program,  rather  than  buy  a  new  one.  The  particular  piece  of  equipment  may 
permit  combining  several  tasks,  rather  than  individually  training  each.  In  the 
above  example,  this  corresponds  to  choosing  one  of  the  other  sums  in  the  task  row, 
which  relates  to  the  particular  piece  of  equipment  you  desire  to  use.  If  you 
were  to  do  this  for  ail  six  tasks,  i.e.,  force  the  choice  of  a  single  piece  of 
equipment,  the  sum  of  the  mxnbers  corresponding  to  that  piece  of  equipment  would 
be  lower.  Thus,  the  efficiency  of  that  particular  decision  would  be  lower  tnan 
the  ideal  case,  a3  would  all  other  potential  combinations.  If  this  value  is  then 
divided  by  the  ideal  first  value,  what  would  be  produced  i3  a  ratio  of  actual  to 
ideal,  or  in  the  terminology  used  above,  an  efficiency  ratio. 

b.  After  you  have  recorded  in  the  three  matrices  (Figure  III-10)  the 
selection  scores  for  each  task,  select  the  largest  value  entered  for  that  task 


(a)  STIMULUS 


Figure  III-  10 .  Overall  Measure  Matrices 


in  each  matrix.  Add  these  largest  values  for  each  task  in  each  matrix.  This 
produces  three  sums  for  each  matrix:  ^stimulus,  ^response,  and  5feedback. 

c.  Add  the  three  S  values  together  for  a  measure  of  the  overall  fit  of 
the  media  combination  chosen  for  all  tasks  and  all  functions. 

S  S  S 

Overall  Measure  =  stimulus  +  response  +  feedback 

d.  Record  the  overall  measure.  Sum  each  column  of  each  matrix.  Repeat 
the  above  procedure,  after  removing  the  media  in  each  stimulus,  response,  and 
feedback  matrix  having  the  lowest  column  sum  across  all  tasks.  Record  this  new 
overall  measure  and  repeat  until  all  media  have  been  considered. 

e.  Plot  the  ratios  of  the  overall  measure  values,  using  the  first  value 
as  the  denominator  for  all  the  remaining  values. 
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2.  DIVAD  Gun 


Given  "generic"  tasks  as  developed  in  paragraph  A.1.  (page  III— 1 )  and 
training  alternatives  as  developed  in  paragraph  B.3  (page  III-20),  you  must 
again  use  your  judgment  and  your  subject  matter  expertise  or  someone  else's. 

You  probably  will  have  no  measures  of  effectiveness,  but  may  still  be  able  to 
rank  order  the  alternatives  as  to  expected  effectiveness.  For  example,  the 
analyst  in  the  DIVAD  Gun  CTEA  formulated  these  three  training  alternatives  (see 
paragraph  B.3,  page  III-20). 

a.  Training  conducted  with  operational  equipment  only. 

b.  Training  conducted  with  reduced  operational  equipment  augmented 
by  the  classroom  trainer. 

c.  Training  conducted  with  further  reduced  operational  equipment 
augmented  by  both  the  classroom  trainer  and  the  maintenance 
trainer . 

The  first  alternative  was  judged  not  likely  to  be  effective  because  of 
its  relative  inflexibility  in  presenting  a  variety  of  battlefield  scenarios  to 
the  student;  the  other  two  alternatives,  because  of  the  presence  of  the  class¬ 
room  trainer,  offered  this  capability.  Of  the  other  two  alternatives,  alterna¬ 
tive  c  was  judged  most  likely  to  be  the  more  effective  because  of  the  presence  of 
the  maintenance  trainer. 

As  with  the  generation  of  tasks  and  training  alternatives,  this  method 
is  largely  intuitive  and  judgmental.  As  such,  you  would  not  use  it  unless  you 
had  nothing  else. 

3.  Analogous  Task  Method 

Having  developed  a  training  program  by  the  analogous  task  method  (see 
paragraph  B.4.  above),  obtain  performance  information  to  be  used  as  a  measure 
of  effectiveness  of  the  training.  The  measure  is  defined  as  the  proportion  of 
soldiers  achieving  criterion  performance  on  the  task  following  training.  If 
data  from  the  hands-on  portion  of  the  Skill  Qualification  Test  (SQT)  are  avail¬ 
able  for  that  task,  then  use  them  to  calculate  effectiveness.  If  not,  use  the 
written  portion  in  their  place.  Where  no  SQT  data  are  available,  use  data  from 
an  end-of-course  test.  In  the  absence  of  all  formal  assessment  tests,  ask  the 
instructor  to  estimate  the  proportion  of  soldiers  who  learn  the  task. 

If  the  Course  of  Instruction  (COI)  for  the  target  task  is  identical  to 
that  of  the  analogous  task,  use  the  effectiveness  measure  for  the  analogous  task 
as  the  estimate  of  effectiveness  for  target  task. 

If  the  COI  differ,  use  the  effectiveness  data  from  SOT  or  end-of-course 
tests  as  a  criterion  against  which  you  compare  the  proposed  effectiveness.  En¬ 
sure  that  the  criterion  dimensions  for  the  two  are  the  same.  If  you  have  iden¬ 
tified  more  than  one  analogous  task,  combine  the  data  in  the  following  manner. 

If  the  COI  and/or  lesson  plans  are  roughly  the  same,  average  the  effectiveness 
measures  to  obtain  the  estimate  of  effectiveness  for  the  target  task.  If  the 
COI  differ  among  the  analogous  tasks,  select  that  with  the  highest  effectiveness 
measure . 
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As  data  on  training  are  obtained  from  OT  I  and  OT  II,  substitute  the 
direct  estimates  for  performance  on  the  task  for  the  measures  based  on  analogous 
tasks. 


Since  training  for  different  tasks  may  develop  at  different  rates  or 
you  may  find  analogous  tasks  for  only  some  of  the  critical  tasks,  it  is  entirely 
possible  that  some  of  the  tasks  will  have  only  analytical  measures  while  others 
have  performance  measures.  Therefore,  combining  measures  into  a  single  aggre¬ 
gate  effectiveness  measure  will  not  be  meaningful.  Even  if  all  measures  are 
performance  measures,  a  reasonable  set  of  weights  for  combining  the  measures 
may  be  difficult  to  deduce.  In  both  cases,  a  verbal  rather  than  numerical  over¬ 
view  of  training  is  suggested. 

4.  TRAINVICE ,  PM  TRADE,  Training  Device  Requirements  Document  Guide: 

A  Procedures  Handbook  for  Directorate  of  Training  Development  Project 
Offices  for  Devices,  1979. 

If  it  is  known  that  a  simulator  or  o.  er  major  training  device  is 
planned  or  considered  for  a  weapon  system,  the  CTEA  analyst  may  need  to  esti¬ 
mate  the  effectiveness  of  the  devices  as  part  of  the  overall  training  effec¬ 
tiveness  prediction.  (Please  note,  however,  that  if  a  major  device  has  been 
identified  as  required,  procedures  specify  a  separate  LCSHM  approach  with  a 
COEA,  CTEA,  etc.,  specific  to  its  development.)  An  excellent  method  for  you  to 
use  for  this  is  TRAINVICE.  Five  separate  analyses  are  required.  These  are: 

o  Task  commonality  analysis 

o  Physical  similarity  analysis 

o  Functional  similarity  analysis 

o  Learning  deficit  analysis 

o  Training  technique  assessment 

Information  on  similar  devices  already  in  the  Army  inventory  may  be 
helpful  and  may  be  obtained  by  contacting  the  Army  Training  Support  Center 
(ATSC),  Ft.  Eustis.  This  group  has  access  to  information  on  all  Army  training 
devices  now  produced  or  being  developed.  They  will  need  from  you  all  the  data 
available  so  far  concerning  the  task(s),  skill  and  knowledge,  and  operational 
effectiveness  objectives.  If  you  have  identified  training  media  characteristics, 
they  should  receive  these  data  also. 

The  action  officer  at  ATSC  can  then  determine  if  training  devices  in 
the  inventory  have  characteristics  that  match.  An  exact  match  on  all  character¬ 
istics  is  unlikely  but  some  currently  inventoried  devices  may  have  several  in 
comnon  with  your  requirements.  For  each  device  ATSC  should  send  you  a  list  of 
tasks  it  is  designed  to  train.  For  tasks  that  correspond  to  task  training 
requirements,  additional  information  that  gives  a  list  of  task  elements  (or 
subtasks)  for  each  task  and  a  list  of  controls  and  displays  involved  in  the 
performance  of  each  task  may  also  be  provided.  If  no  existing  device  data  are 
available,  theoretical  device  concepts  may  be  substituted.  A  hypothetical 
'ideal'  device  would  oe  a  perfect  match  on  all  variables  and  you  may  modify 
as  seems  advisable  to  match  known  constraints  of  time,  equipment,  etc. 
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To  analyze  alternative  device  effectiveness  you  may  proceed  as  in  the 
following  example.*  Suppose  you  are  comparing  three  alternative  proposed  train¬ 
ing  devices.  We  will  assume  for  this  example  that  devices  A,  B,  and  C  are  pro¬ 
posed;  that  devices  similar  to  A  and  B  exist;  and  C  is  as  yet  only  a  concept. 

Two  known  task  training  requirements  are  Task  1 ,  Fire  main  gun  using  primary 
sight  (M-32);  and  Task  2,  Adjust  fire  using  Burst  on  Target  ( M— 32  sight).  These 
tasks  and  their  subtasks  may  be  listed  as  shown  in  Table  III-10.  Next  you  will 
perform  the  five  analyses.  Task  Comnonality  is  first. 

a.  Task  Commonality .  For  each  task  to  be  trained  on  each  training  de¬ 
vice  you  will  derive  a  task  conmonality  index.  Using  a  table  as  shown  in  Figure 
III— 1 1 ,  proceed  as  follows: 

( 1 )  List  the  task  elements  down  the  left  column  of  Figure  III-1 1 . 

(2)  List  the  training  devices  or  concepts  to  be  assessed  across 
the  top  of  the  table. 

(3)  For  each  device  or  device  concept  under  consideration  list 
on  a  separate  piece  of  paper  the  elements  of  the  task  as  they  would  be  trained 
on  that  device. 

(4)  For  each  task  element  in  the  left  column  cf  Figure  III- 11 
determine  whether  a  device  enables  the  trainee  to  practice  that  task  element 
by  examining  the  separate  list  of  task  elements  for  that  device. 

(5)  If  the  training  device  does  allow  practice  of  that  opera¬ 
tional  task  element,  then  enter  a  "I"  in  the  appropriate  cell  for  that  device. 

(6)  If  the  particular  task  element  is  not  represented  in  the 
training  device,  either  because  the  task  is  truncated  or  simplified,  then 
enter  a  "0"  in  the  appropriate  cell. 

(7)  Repeat  this  procedure  for  each  task  element  of  the  training 

task. 

(8)  Repeat  the  entire  procedure  for  each  training  device  or  de¬ 
vice  concept  under  consideration. 

(9)  For  each  training  device  or  device  concept  under  considera¬ 
tion,  total  the  number  of  "I's"  (i.e.,  the  number  of  task  elements  for  which 
the  training  device  allows  the  trainee  to  actually  practice  the  training  task) . 

(10)  Enter  the  total  number  of  "I's”  for  each  device  in  Figure 

III-11. 

(11)  Derive  the  task  commonality  index  value  by  dividing  the  total 
number  of  "I's"  by  the  total  number  of  task  elements  in  the  training  task  plus 
the  total  number  of  task  elements  unique  to  a  device  which  are  not  related  to 
the  training  requirements.  The  number  of  elements  unique  to  a  device  and  not 


•The  source  of  the  illustrative  example  is  the  referenced  document,  PM  TRADE 
(1979). 
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•i.w*,,: 


Table  III-10.  Example  Task  Training  Requirements 


TASK:  Fire  main  gun  using  primary  sight  (M-32). 

Task  Elements: 

1.  Upon  receipt  of  the  alert  element  of  the  fire  command,  places  turret 
power  switch  in  "on"  position.  (Alert) 

2.  Upon  receipt  of  the  ammunition  element  of  the  fire  command,  places 
main  gun  power  switch  in  "on"  position  and  coaxial  machine  gun 
switch  to  the  appropriate  position.  (Select  Gun) 

3.  Index  appropriate  ammunition  into  the  computer,  using  the  ammunition 
selector  control.  (Index  Computer) 

4.  Upon  receipt  of  the  target  element  of  the  fire  command,  monitors  unity 
window  for  target,  and,  when  located  announces,  "Identified."  (Monitor) 

5.  Upon  receiving  control,  operates  controls  to  place  cross  hairs  of 
sight  on  center  of  target  vulnerability.  (Initial  Aim) 

6.  Tracks  target.  (Track) 

7.  Upon  receipt  of  execution  element  of  fire  command,  checks  final  lay 
of  the  gun  and  applies  appropriate  lead,  (final  Aim) 

8.  Hears,  "Up,"  announces,  "On  the  way,"  pauses  one  second,  and  squeezes 
trigger.  (Fire) 


.ASK:  Adjust  fire  using  Burst  on  Target  (M-32  Sight). 

Task  Elements: 

1.  Upon  firing,  monitors  sight  for  target  and  relays  as  necessary  to 
reacquire  the  original  sight  picture.  (Relay) 

2.  Senses  the  round  (observes  burst  in  relation  to  target,  and  determines 
new  aiming  point  on  reticle)  and  begins  to  relay.  (Sense) 

3.  Operates  controls  to  p 1  a «  e  new  aiming  point  on  center  of  target 
vulnerability.  (Apply  BOf) 

4.  Tracks  target.  (Track) 

5.  Hears,  "Up,"  announces,  "On  the  way,"  pauses  one  second,  and  squeezes 
trigger.  (Fire) 
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NAME  OF  TASK 


p\r  o,  /Y\g tvy  £au.*y  P** 


REQUIRED  TASK  ELEMENTS 


’•  /?/ert 


2'  Se.|e.c/fc  &uw 


3  X>\cJetf  Comp  u'fccv' 


4  rQov\i*t.or 


Aiw\ 


6  Tra. ck 


7  F  l  *\  <K  I  Aim 


8  FY 


Total  number  of  l'i 


Task  Commonality 
Index 


DEVICE  A 


rrs"--88 


OEVICE  B 


DEVICE  C 


Task  Commonality  ■  tf  of  1‘s  for  Oevice 

Index  (*  of  Rqd  Task  Elements)  ♦  of  Unique  Element  m  Device  ) 


Figure  III-ll.  Example  Task  Commonality  Analysis 
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needed  is  included  in  the  formula  to  reduce  the  final  effectiveness  score  for 
those  devices  offering  greater  capability  (and  therefore  cost  more)  than  actually 
required . 


A  separate  task  commonality  table  is  used  for  each  task.  You  will  see  a  second 
example,  Task  2,  at  Figure  III-12.  How  faithfully  the  element  is  represented 
in  a  training  device  is  considered  separately. 

b.  Physical  Similyity.  A  physical  similarity  analysis  is  based  on 
the  physical  similarity  or  fidelity  of  displays  (cues)  and  controls  (responses) 
in  a  training  device  when  compared  to  the  operational  equipment.  The  following 
procedure  is  applied  to  each  task.  The  first  example  is  Task  1,  shown  in  Fig¬ 
ure  III-13. 


( 1 )  List  the  controls  and  displays  involved  in  task  performance 
down  the  left  column  of  Figure  III-13. 

(2)  List  the  training  devices  or  training  device  concepts  to  be 
assessed  across  the  top  of  Figure  III— 1 3 . 

(3)  For  each  control  or  display  listed  in  the  left  colunn  of  Fig¬ 
ure  III-13,  rate  how  well  it  is  physically  represented  in  each  training  device 
or  device  concept  under  consideration.  Base  your  ratings  of  physical  similarity 
on  the  four-point  scale  given  in  Table  III-11. 


_ Table  III-ll.  Physical  Similarity  Rating  Scale _ 

Rating  Definition 

3  Identical .  The  trainee  would  not  notice  a  difference  between 

the  training  device  control  or  display  and  the  operational 
control  or  display  when  he  moves  from  the  training  to  the  job 
situation.  Include  for  consideration  the  location,  appearance, 
feel,  and  any  other  physical  characteristics.  Ignore  the  amount 
and  quality  of  information  transmitted. 

2  Similar.  There  would  be  a  small  noticeable  difference  for  the 

trainee  between  the  training  device  control  or  display  and  the 
operational  control  or  display,  but  he  would  be  able  to  perform 
the  task.  There  might  be  a  decrement  in  performance,  but  any 
such  decrement  would  be  small  and  readily  overcome. 

1  Dissimilar.  There  would  be  a  large  noticeable  difference  quite 

apparent  to  the  trainee,  between  the  training  device  control  or 
display  and  the  operational  control  or  display  and  a  large  per¬ 
formance  decrement,  given  that  the  trainee  could  perform  at  all. 
Specific  instruction  and  practice  would  be  required  on  the  oper¬ 
ational  equipment  after  practice  on  the  training  device  to  over¬ 
come  the  decrement. 

0  Missing.  The  control  or  display  is  not  represented  at  all  In  the 

training  device. 


NAME  OF  TASK 


fid  iusi  Fire.  Us  //i<?  Surtt  cn  Tar 


REQUIRED  TASK  ELEMENTS 


Task  Commonality 
Index 


Task  Commonality  ■  _  #  of  1's  for  Device 

Index  (#  of  ftq'd  Task  Elements)  +  (#  of  Unique  Element  in  Oevice  I 


Figure  I X I— 1 2 .  Example  Task  Commonality  Analysis 
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name  of  task  P Plctm  U  si W  Primary  S'3^ 

—  -  —  .  .  ■ — '  I 


REQUIRED  TASK 

CONTROLS  AND  OISPLAYS 

DEVICE  A 

OEVICE  8 

DEVICE  C 

i-  fccur  phene. 

O 

O 

O 

oaJ/o^P  Amtion  o £ 

2'  Tnrrc.“t-  en  Suit  4c  k 

A 

3 

3 

Turret^ 

©l 

3 

3 

ott/otP  Pei  'it/tn.  af( 

4. /?7a/<t  7ej$/«  S*Jiie-k. 

A 

3 

3 

on/of p  ,%s  !*t /a  n  o/" 

§  G04.X ie.(  /Yla.t-kt<*G  6«*a. 
Su/'fcties 

A. 

3 

3 

CoA-X  IA.  /  /T?AC Ai*lt 

6-  6mk  5wJ '  7*c-4. 

A 

3 

3 

7.  Xndfentin.^  tOmdoM? 

A 

3 

3 

8 -£nJe.%tn&  Handle. 
Feedoax.k. 

/ 

3 

3 

9.  Ia<^c<»a^  Ha.*i  1^, 

1 

3 

3 

10.  UnHy  WmJoui 

3, 

3 

3 

Continue  J  cn  next />*■•}  e  ■ 


Figure  III-13.  Example  Physical  Similarity  Analysis 
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REQUIRED  TASK 

CONTROLS  AND  DISPLAYS 

DEVICE  A 

DEVICE  B 

DEVICE  C 

^  ffltcrop  ken  e 

o 

o 

O 

<2  Cod/  //ac  Co  ft  fro  t 
Feed 

o 

3 

3 

,  A/-3A 

3  <<«-*.? ) 

<ZL 

•  <  Pe."tic./c. 

A 

3 

3 

Cadf  //ac  £"/« 

/ 

3 

3 

■  ■ 

1 6.  Pa.!** i  5^W«/<-Xc4 

o 

3 

3 

(?  ^-3  A  5^At. 

CdyiAmtt.  fa.r£  tf.  ) 

o 

«* 

A 

18.  Prtf*i&rj 

o2. 

oL 

A 

,9‘  £*>.*•.  l€S 

3 

3 

IP- 

Sum  of  Physical  Similarity  Ratings 

<2.6* 

48 

48 

Physical  Similarity  Index 

3(H)+k  v 

*8  -  fin 
3USHS 

1+8  -  84 

3(1^40  «0T 

Physical  Similarity  ■  _ Sum  of  Similarity  Ratings  fpr_De»j£g - ; - ! 

Index _  3(^  of  Rq'd  Controls  &  Displays)  »  (=  of  Controls  &  Duplays  Unique  to  Device) 


Figure  III-13.  Example  Physical  Similarity  Analysis  (concluded) 
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(4)  Repeat  the  procedure  for  each  training  device  or  training  de¬ 
vice  concept  under  consideration. 

(5)  For  each  training  device  or  device  concept  under  considera¬ 
tion  add  the  ratings  for  each  control  and  display  listed  to  obtain  a  total  score. 

(6)  Enter  the  total  score  for  each  device  in  Figure  III— 1 3 . 

(7)  Total  the  number  of  controls  and  displays  unique  to  a  device 
or  device  concept  in  addition  to  the  required  set  of  controls  and  displays. 

These  are  controls  and  displays  unrelated  to  the  training  requirements. 

(8)  Derive  the  physical  similarity  index  value  by  dividing  the 
sun  of  physical  similarity  ratings  bv  three  times  the  number  of  controls  and 
displays  plus  the  number  of  controls  and  displays  unique  to  a  device  or  device 
concept . 


(9)  Enter  the  physical  similarity  index  value  in  Figure  III— 1 3 . 

A  separate  physical  similarity  table  is  used  for  each  task.  Our  selected  Task  2 
is  shown  in  Figure  III-14.  How  faithfully  the  training  device  represents  the 
functioning  of  the  operational  equipment  is  considered  next. 

c.  Functional  Similarity.  The  functional  similarity  analysis  compares 
the  operator's  behavior  in  terms  of  the  information  flow  from  each  display  to 
the  operator,  and  from  the  operator  to  each  control.  You  will  assess  this  in 
terms  of  the  amount  of  information  transmitted  from  each  display  to  each  control 
and  the  type  of  information-processing  activity  performed  by  the  operator.  The 
issue  is  not  the  physical  fidelity  of  a  control  or  display,  but  whether  the 
operator  acts  on  the  same  amount  of  information  in  the  same  way  in  both  opera¬ 
tional  and  training  situations. 

Controls  and  displays  are  considered  together  with  task  elements 
to  determine  the  type,  amount,  and  direction  of  information  flow  occurring 
during  task  performance.  Each  situation  in  which  a  display  transmits  informa¬ 
tion  to  the  operator  (e.g.,  reads  it)  is  defined  as  a  stimulus  function,  while 
each  situation  in  which  the  operator  transmits  information  to  a  control  (e.g., 
operates  it)  is  termed  a  response  function. 

In  each,  the  amount  of  information  may  be  estimated  by  the  number 
of  states  or  discrete  values  which  the  display  or  control  may  assume.  The  func¬ 
tional  similarity  is  assessed  by  comparing  the  number  of  discrete  values  or 
states  in  the  training  situation.  The  range  of  values  may  be  partitioned  into 
four  major  levels:  (1)  continuous  (essentially  unlimited),  (2)  multivalued 
(seme  discrete  value  greater  than  two),  (3)  binary  (two  values),  or  (4)  not 
represented.  Figure  111-15  shows  performing  functional  similarity  analysis 
for  Task  1 . 


(1)  List  the  controls  and  displays  involved  in  task  performance 
on  the  operational  equipment  down  the  left  column  of  Figure  III-15. 

(2)  List  the  training  devices  or  training  device  concepts  to  be 
assessed  across  the  top  of  Figure  III— 15 . 
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NAME  OF  TASK 


/Miuvt  Fi  re  Usm*L  Burst,  on  Fxr%tA 


REQUIRED  TASK 
CONTROLS  AND  DISPLAYS 


1.  fire  6<zaJc 


,  AI-SAS.aA.* 
CtA.r4.tA.) 


3.  ffe.tic./e. 


DEVICE  A 


OEVICE  B 


DEVICE  C 


5.  Pcu!tv\  Sufi  /e.A  CS 


/>?-35L  S'^Lt 
C  3*trs  t  ) 


/»?'3a.  s 

CPfnaj^tc  Target.  ) 


8.  Peurp  kones 


9.  /rftcrofA.one. 


3.  'Fritter  3c4t7*’ches 


Sum  of  Physical  Similarity  Ratings  j  Q 


Physical  Similarity  Index 


-.*5 


17 _ 


30oHa» 


-.53 


30o^o 


z.6>3 


Physical  Similarity  »  Sum  of  Similarity  Ratings  for  Device 

Index _ 31  -  of  Rq'd  Controls  &  Displays)  *  1=  ot  Controls  &  Disolays  Unique -to  Device^ 


Figure  III-14.  Example  Physical  Similarity  Analysis 


REQUIRED 

TASK  CONTROLS  AND  DISPLAYS 

DEVICE  A 

DEVICE  B 

DEVICE  C 

i.  Ezcirphone. 

3 

3 

3 

Or<t/cfF  f&srt'ton 

2.  Turret  Pc uJ«.r 

3 

3 

3 

mfurre*'t  Power 
“7o^j./e  Switch 

3 

3 

3 

ttf/cFF  Poiii /'on.  /rfaStn. 

4.  d>u«u  7o^j./e  Sun'tc.k. 

3 

3 

3 

0«/«A^  fitSi’t.i on. 

5wiit  K, 

3 

3 

3 

6-  l?Hn  <Su(^cA, 

3 

3 

3 

Bmimfli 

3 

3 

3 

8.  Xnde.jtir\^  Window 

£ 

3 

3 

g  Znde.* 'i^  WAmdlc 
Feedbdxlc 

1 

3 

3 

10-  Xndcx  Mlnd/ft 

/ 

3 

3 

Cot\  fi  n  *ed  c n  Alt  t L  A^e 

Figure  III-15.  Example  Functional  Similarity  Analysis 
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REQUIRED 

TASK  CONTROLS  AND  DISPLAYS 

DEVICE  A 

DEVICE  B 

DEVICE  C 

11.  Um^y  Window 

cA 

<2. 

&ee.d  bicU. 

O 

3 

3 

)3  /tf-ia 

(’tir3.fi  ) 

3 

3 

•4-  Pe.'htc  /e 

3 

3 

3 

(5  CaJJ/ic  47fcva.^/*i£ 

3 

3 

16.  Pa.)* n  $**>t  te-A&& 

O 

3 

3 

|7  /?-3A 

O 

A 

A 

18.  ’Sijkt 

<2. 

/ 

/ 

19.  Tri^er  -Sui^tkes 

3 

3 

3 

ap- 

Sum  of  Functional  Similarity  Rating! 

3<? 

53 

5  3 

Figure  III-15.  Example  Functional  Similarity  Analysis  (concluded) 


(3)  For  each  control  or  display  listed  in  the  left  column  of  Fig¬ 
ure  III-15,  note  how  well  it  is  functionally  represented  in  each  training  device 
under  consideration.  Base  your  ratings  of  functional  similarity  on  the  four- 
point  scale  given  in  Table  III-12. 


Table  III-12.  Functional  Similarity  Rating  Scale 
Rating  Definition 

3  Identical.  The  number  of  states  in  the  training  situation 

is  the  same  as  the  number  of  states  in  the  operational  setting. 

2  Similar.  The  number  of  states  in  the  training  situation  Is  at 

least  half  of  the  number  of  states  in  the  operational  setting. 

1  Dissimilar.  The  number  of  states  in  the  training  situation  Is 

less  than  half  of  the  number  of  states  in  the  operational  setting. 

0  Hissing.  The  control  or  display  is  not  represented  at  all  in 

the  training  device. 


(4)  Repeat  the  procedure  for  each  training  device  or  training  de¬ 
vice  concept  under  consideration. 

(5)  For  each  training  device  or  device  concept  under  considera¬ 
tion  add  the  ratings  for  each  control  and  display  listed  to  obtain  a  total  score. 

(6)  Enter  the  total  score  for  each  device  in  Figure  III-15. 

(7)  Total  the  number  of  controls  and  displays  unique  to  a  device 
or  device  concept  in  addition  to  the  required  set  of  controls  and  displays,  if 
any  such  controls  or  displays  exist. 

(8)  Derive  the  functional  similarity  index  value  by  dividing  the 
sum  of  functional  similarity  ratings  by  three  times  the  number  of  controls  and 
displays  plus  the  number  of  controls  and  displays  unique  to  a  device  or  device 
concept . 

(9)  Enter  the  functional  similarity  index  value  in  Figure  III-15. 

A  separate  functional  similarity  table  is  used  for  each  task.  Our  second  task 
is  anal yzed  for  functional  similarity  in  Figure  III-16. 

d.  Skill  and  Knowledge  Requirements.  This  analysis  assesses  the 
skill  and  knowledge  in  the  student's  repertory  before  training  and  compares 
them  to  the  skill  and  knowledge  required  for  successful  performance  of  the 
training  tasks.  Figure  III-17  shows  how  this  analysis  is  done  for  Task  1. 

( 1 )  Li3t  the  skill  and  knowledge  required  for  successful  task 
performance  down  the  left  colunn  of  Figure  III-17. 


Figure  III-16.  Example  Functional  Similarity  Analysis 


NAME  OF  TASK  Adjust  Fire.  Usi on  "Tar^e.’t 


REQUIRED 

TASK  CONTROLS  ANO  DISPLAYS 

DEVICE  A 

DEVICE  B 

DEVICE  C 

i.  Fiv*e  Feedback. 

0 

O 

o 

,  A1-3JL  SAsA/fc 

CUr^l) 

Eh 

A 

3 

3  L/c/e. 

3 

3 

3 

CclJI Uetc  £/eva.i tin* 

4.  •  & 

7Aa.Vev3fn£  £©m£r»©/ 

oh 

3 

3 

5-  ^c/m  *5u/*/i.Aes 

O 

3 

3 

6.  /*?-3A  sUkt 
(burst.) 

1 

/ 

o 

« ^ 

A 

®  Ea. rp  ho nes 

3 

3 

3 

.  9  fll ic.ro phone. 

3 

3 

3 

io.  Try^er  «S  w  r  f'e.kes 

3 

3 

3 

Sum  of  Functional  Similarity  Ratings 

1 7 

dk3 

£5 

Functional  Similarity  Index 

■LL— ,!_■ 

SSnatEB 

FTOfTttXQI 

Functional  Similarity  •  _ Sum  of  Similarity  Ratinai  for  Device _ _ 

Index  3(r;  o f  Rq'd  Controls  &  Displays)  +  (s  of  Controls  &  Displays  Unique  to  Device) 
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Figure  III-17.  Example  Skill  and  Knowledge  Requirements  Analysis 


NAME  OF  TASK  P/rg  Ui  i  nfl_  Pr/ Artf 


REQUIRED  TASK 

SKILLS  AND  KNOWLEDGE 

AFTER 

TRAINING 

BEFORE 

TRAINING 

DIFFERENCE 
(AFTER  -  BEFORE) 

1  know 

procedure 

4 

0 

4- 

JUA 

Selection,  foe edure 

4 

o 

4- 

Rv$W  tOmp  u.tt>r 
<n  di'j^.jpro  c^-d  uv  e 

4- 

o 

4- 

4  know  fncmtar 
pratiJave. 

3 

o 

3 

Know  a.iw\ 

5  proce.du.re 

3 

o 

3 

g  Know 

procedure 

4- 

o 

4 

know  find  aim 
procedure 

4 

o 

4 

8  K^iJ  ■Pi're. 
procedure 

3 

O 

3 

Know  ea*it.v>ol//di)plc^ 

9-  location  (cL.l6.rt ) 

4 

0 

4- 

Know)  Control/diipln^ 

10-  location  £i*/ect  |«*0 

4 

0 

4 

w 

1 
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Figure  HI-17.  Example  Skill  and  Knowledge  Requirements  Analysis 
(continued) 


NAME  OF  TASK  /*7a«  H.  (Sun 


REQUIRED  TASK 

SKILLS  AND  KNOWLEDGE 

AFTER 

TRAINING 

BEFORE 

TRAINING 

DIFFERENCE 
(AFTER  -  BEFORE) 

K<v*w  |  /Jiif  U.t^ 

1  ,  UcAtiOA  (inde* 
Computer  ^ 

4- 

0 

4 

K«v*w  cowfcr-ol /display 
*  2-  location  (*nowi+air} 

4- 

o 

4 

COntral/dlSplA.^ 

13.  location  a'(»n) 

4 

6 

4 

K.r\oio  CCxv^roly/diip/4.^ 

1  4- Isca/tio^.  (ti»A.ck) 

4 

0 

4 

knao  COrv4.r«l/d<  tp  l«u^ 

*  5-  i  scat  I  0  «.  (f  V  Aftl  A*l  n>1  } 

4 

0 

Lf- 

Know  Oontvo(/^i*p/o-i{ 

*  ®‘  e') 

4 

0 

4 

/y?-3o. 

,7‘  5i3kt 

4“ 

0 

4 

/?rvw*\*  * lLa-  i  rvdat  »n/ae 

*8  £mMtfi»>r»A.aiio«V 

. 

4 

o 

4 

7Sr^«'t  c/««cp<Vt*rj -•&«  * 
19.  target 

ms  fbr  ruA'tic  n. 

3 

o 

3 

^ec©jn»te  T+rjftt 
a*°-  %N«W/y 

A 

o 

cP>. 

on  /l  ft  *  £ 
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REQUIRED  TASK 
SKILLS  AND  KNOWLEDGE 


“CCvcfcev  ef 

>/ ulviera.b « frty  '* 


oL2.  I  <*MA^ 


De-fcec.4  "tra.wjfe.r 
of  £©v\i.vol 


•L4.  Tr<u.lctv\.^ 


i  **a  -  o-Pl P 


£>tiv-s4.te  on.® 
A'6'  Secovv.4 


3s 7 .  Le«LcJ 


£)»«.ru4*  CO*c£»*e  / 
bfmdly  C&ltr’k') 


Opera,  te  Co rvfc v o  1 
blindly  ^Stlecf"  ^uaY 


Operate  covvtrol 
3®-  blindly  ^cv^ey 
ce.*vBu.ter> 


Total  Difference  Score 


AFTER 

TRAINING 


BEFORE 

TRAINING 

DIFFERENCE 
(AFTER  -  BEFORE) 

0 

3 

o 

3 

o 

Hr 

o 

3 

0 

4- 

■+ 


103 


f03  _ 
Y(30>  ** 


=  .8fc 


Skill  Si  Knowledge 
Requirement}  Index 


Total  Difference  Score _ 

4  (Number  of  Skills  &  Knowledge) 


(2)  For  each  skill  or  knowledge  listed  in  the  left  column  of 
Figure  III-17 ,  estimate  how  "much”  of  the  skill  or  knowledge  the  average  trainee 
could  be  expected  to  have  upon  first  exposure  to  the  training  device,  and  esti¬ 
mate  how  much  of  the  skill  and  knowledge  he  must  possess  at  training's  comple¬ 
tion.  Use  the  two  scales  in  Tables  III-13  and  III- 14. 


Table  III-13 •  Rating  Scale  for  Skills  and  Knowledge  Before  Training 
Rating  Definition 

4  Has  a  complete  understanding  of  the  subject  or  skill.  Can  do 

the  task  completely  and  accurately  without  supervision.  Has 
received  "skill"  training. 

3  Understands  the  subject  or  skill  to  be  performed.  Has  applied 

part  of  the  knowledge  or  skill  either  on  the  actual  job  or  a 
trainer.  Has  done  the  job  enough  times  to  make  sure  he  can  do  it, 
although  perhaps  only  with  close  supervision.  Has  had  "proce¬ 
dural"  training. 

2  Has  received  a  complete  briefing  on  the  subject  or  skill.  Can  use 

the  knowledge  or  skill  only  if  assisted  in  every  step  of  the 
operation.  Requires  much  more  training  and  experience.  Has 
received  "familiarization"  training  only. 

1  Has  only  limited  knowledge  of  this  subject  or  skill.  Has  not 

actually  used  the  Information  or  skill.  Cannot  be  expected  to 
perform.  Has  had  "orientation"  only. 


0 


No  experience,  training,  familiarity,  etc.,  with  this  skill  or 
knowledge.  Canno*  perform  a  task  requiring  this  skill  or 
knowledge. 


t 

f 

I 


Table  III- 14.  Rating  Scale  for  Skills  and  Knowledge  After  Training 
Rating  Definition 

4  Should  have  a  complete  understanding  of  the  subject  or  be 

highly  skilled.  Is  able  to  perform  the  task  completely, 
accurately,  and  independently.  Has  had  "skill"  training. 

3  Should  have  an  understanding  of  the  subject  or  skill  to  be 

performed.  Has  applied  part  of  the  knowledge  or  skill  on  the 
actual  job  or  a  trainer.  Has  done  the  job  enough  times  to 
make  sure  he  can  do  it  although  perhaps  only  with  close  super¬ 
vision.  Needs  more  practice  under  supervision.  Has  had 
"procedural"  training. 

2  Should  have  received  a  complete  briefing  on  the  subject  or 

task.  Is  able  to  use  the  knowledge  or  skill  only  if  assis¬ 
ted  in  every  step  of  the  operation.  Requires  much  more  train¬ 
ing  and  experience  to  be  able  to  perform  the  task  Independently. 
Has  had  "familiarization"  training. 

1  Should  have  limited  knowledge  of  the  subject  or  skill.  Has 

not  actually  used  the  information.  Is  not  expected  to  perform 
the  task.  Has  completed  "orientation"  training. 

0  At  the  end  of  training,  the  trainee  should  have  no  experience 

or  training. 


^3'  Compute  the  differences  between  skill  and  knowledge  require¬ 
ments  before  and  after  training  by  subtracting  the  before-training  value  from 
the  after- training  value  for  each  skill  or  knowledge.  (Negative  differences 
are  set  equal  to  zero,  because  they  indicate  the  trainee  enters  with  more  skill 
than  necessary.) 

',4)  Add  the  difference  scores  ("after"  minus  "before"  ratings)  for 
the  skills  and  know: edges  listed  to  obtain  a  total  difference  score. 

vt)  Enter  the  total  difference  score  for  each  device  in  Figure 

111-17. 

it>)  Derive  the  skill  and  knowledge  requirements  index  by  dividing 
the  t-ual  difference  score  by  four  times  the  number  of  skills  and  knowledges. 

v7)  Enter  the  skill  and  knowledge  requirements  index  value  in 
Figure  III-17. 


A  separate  skill  and  knowledge  requirements  table  is  used  for  each  task.  Task  C 
is  analyzed  on  Figure  III-lS. 


Figure  III-18.  Example  Skill  and  Knowledge  Requirements  Analysis 
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Figure  III-18.  Example  Skill  and  Knowledge  Requirements  Analysis 
(concluded) 


■■MBIMHNIB&jMi 

REQUIRED  TASK 

SKILLS  AND  KNOWLEDGE 

AFTER 

TRAINING 

BEFORE 

TRAINING 

DIFFERENCE 
(AFTER  -  BEFORE) 

rf)^3Q. 

n.  5 ,3kt 

4- 

O 

4 

12.  C8et<Lcj^ 

4- 

O 

4 

BSBBBBMM 

3 

0 

3 

14  t)e  Ao"t  <t»\«\ow»vce. 11 

H- 

o 

4- 

* 5< 

3 

o 

3 

1 6.  Airmn^C'kfP^  BoT) 

3 

o 

3 

|  7.  Tvtxtkm^ 

3 

o 

3 

1 8.  fij/rwunfe  cue 

5&C.©*t^ 

3 

ok 

1 

f9. 

A.O. 

Total  Difference  Score 

-  V-*.  '  *•  ■  >•*! 

;C;',  V.  ;  I 

(o  5 

Skill  &  Knowledge 

„■  .  *•  -•»  ■-  ■  ■  ■>..•■  V  -.4 

65  -  .  q /^) 

Requirements  Index 

•  ,  *  w  I  V 

•  ». - -  '  'J 

408^ 

Skill  &  Knowledge  ■  Total  difference  Scorn _ 

Requirements  Index  4  (Number  of  Skills  &  Knowledge) 


f 


HI-59 


e.  Task  Training  Difficulty.  A  task  training  difficulty  analysis 
estimates  the  difficulty  (in  terms  of  training  time)  of  training  soldiers  to 
successfully  perform  the  required  tasks.  Ratings  are  assigned  based  on  the 
assumption  that  training  occurs  on  the  operational  equipment.  Figure  III-19 
shows  this  analysis  for  Task  1 . 

(1)  List  the  task  elements  down  the  left  column  of  Figure  III-19. 

(2)  For  each  task  element  listed,  rate  the  amount  of  training  time 
for  surmounting  its  associated  deficit  relative  to  the  most  time-consuming  task 
element.  Table  III- 15  is  used. 


Table  III-  15.  Task  Training  Difficulty  Rating  Scale 


Fating 

Definition 

4 

Requires  as  much  time  to  train  as  the  most 
time-consuming  task  element,  considering  all 
task  elements  for  all  tasks  in  the  current 
analysis 

3 

Requires  substantial  training  time,  but  less 
than  above 

2 

Requires  a  moderate  amount  of  training  time 
relative  to  the  most  time-consuming  task  element 

1 

Requires  only  minimal  training  time  relative 
to  the  most  time-consuming  task  element 

0 

Requires  no  training  time 

t3)  Add  the  training  difficulty  ratings  for  the  task  elements 
listed  to  obtain  a  total  training  difficulty  score. 

(4)  Enter  the  total  training  difficulty  score  in  Figure  III-19. 

(5)  Derive  the  task  training  difficulty  index  by  dividing  the 
total  training  difficulty  score  by  four  times  the  number  of  task  elements. 

(6)  Enter  the  task  training  difficulty  index  value  in  Figure 

in-19. 

A  separate  task  training  difficulty  table  is  used  for  each  task  (see  Figure 
III -20  for  Task  2).  Note,  however,  the  rating  scale  is  used  by  evaluating 
training  time  for  each  task  element  relative  to  the  most  time-consuming  element 
for  all  tasks  in  the  current  analysis. 
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Figure  III-19.  Example  Task  Training  Difficuj 
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f.  Index  of  Training  Device  Effectiveness.  From  the  five  analyses 
just  completed  you  will  derive  overall  indexes  of  effectiveness  for  each  train¬ 
ing  device  or  training  device  concept  under  consideration. 

o  Task  commonality 

o  Physical  similarity 

o  Functional  similarity 

o  Skill  and  knowledge  requirements 

o  Task  training  difficulty 

The  task  commonality,  physical  similarity,  and  functional  similarity  analyses 
were  conducted  on  a  task-by-task  basis  for  each  training  device  or  training 
device  concept.  The  skill  and  knowledge  requirements  and  task  training  diffi¬ 
culty  analyses  were  independent  of  any  particular  device  and  addressed  specific 
personnel  and  training  requirements.  The  following  procedure  is  used  to  derive 
task  level  training  effectiveness  indexes. 

( 1 )  List  the  tasks  requiring  training  down  the  left  column  of 
Figure  III-21 . 

(2)  Obtain  task  commonality,  physical  similarity,  and  functioned 
similarity  index  values  derived  in  previous  analyses  (Figures  XII— 1 1 ,  III-13, 
III-15)  for  each  task  as  listed  on  Figure  III-21 . 

(3)  Enter  these  values  in  the  appropriate  columns  of  Figure  III-21 . 

(4)  For  each  task,  add  the  listed  task  commonality,  physical  simi¬ 
larity,  and  functional  similarity  scores  and  divide  by  three.  The  obtained 
value  indicates  the  degree  of  correspondence  between  the  operational  equipment 
and  the  particular  training  device  for  that  task. 

(5)  Repeat  this  analysis  for  each  training  device  (see  Figures 
III-22  and  III-23). 

g.  Personnel  and  Training  Requirements  Analysis.  The  next  analysis 
summarizes  the  personnel  and  training  requirements  analyses. 

(1)  List  the  tasks  requiring  training  down  the  left  column  of 
Figure  III-24. 

(2)  Obtain  the  skill  and  knowledge  requirements  and  task  training 
dificulty  index  values  derived  in  previous  analyses  (Figures  III-17  and  III-19) 
for  each  task  listed  in  Figure  III-24. 

(3)  Enter  these  values  in  the  appropriate  columns  of  Figure  III-24. 

(4)  For  each  task,  add  the  listed  skill  and  knowledge  requirements 
and  task  training  difficulty  index  values  and  divide  by  two.  The  obtained  value 
indicates  the  extent  of  training  required  based  on  skills  and  knowledge  require¬ 
ments  and  abilities  of  the  typical  trainee. 
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Figure  III-21.  Example  Training  Device  and  Operational  Equipment 
Task  Level  Correspondence 
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Figure  III-22.  Example  Training  Device  and  Operational  Equipment 
Task  Level  Correspondence 


Figure  III-23.  Example  Training  Device  and  Operational  Equipment 
Task  Level  Correspondence 


NAME  OF  DEVICE. 


10. 


Figure  III-24.  Example  Task  Level  Personnel  and  Training  Requirements 


h.  Overall  Training  Device  Effectiveness  Index.  The  final  analysis 
derives  overall  training  device  effectiveness  indexes  for  each  device  or  device 
concept  by  combining  the  task  level  training  device  and  operational  equipment 
correspondence  analysis  and  the  task  level  personnel  and  training  requirements 
analysis . 

( 1 )  List  the  tasks  requiring  training  down  the  left  column  of 
Figure  111-25. 

(2)  List  the  training  devices  or  training  device  concepts  to  be 
assessed  across  the  top  of  Figure  III-25. 

(3)  Obtain  the  TC  +  PS  +  FS  and  SKR  +  TTD  values  for  each  task  and 

3  2 

for  each  training  device  from  Figures  IiI-23  and  III-24  and  enter  them  in  the 
appropriate  columns  of  Figure  III-25. 

(4)  Multiply  the  TC  +  PS  +  FS  and  SKR  +  TTD  values  for  each  task 

3  2 

and  enter  in  the  appropriate  column  labeled  product. 

(5)  Add  the  product  values  for  all  tasks  and  enter  the  sum  in 
the  sum  of  products  location  for  that  device. 

(6)  Add  the  SKR  +  TTD  values  for  each  task  and  enter  the  sum  in 

- ^ - 

the  sum  of  SKR  +  TTD  location  for  that  device. 

2 

(.7)  Divide  the  value  from  Step  5  ("A")  by  the  value  from  Step  6 
("B").  This  value  is  the  training  device  effectiveness  index  for  that  training 
device  concept. 

(d)  When  comparing  alternative  existing  device  concepts,  an 
effectiveness  index  is  adjusted  by  multiplying  it  by: 

_ #  of  Required  Tasks _ 

(#  of  Required  Task)  +  (#  of  Tasks  Unique  to  the  Alternative) 

This  factor  accounts  for  capabilities  within  an  existing  device  that  are  not 
required  for  the  device  under  consideration.  Capabilities  not  required  mean 
additional  cost,  and  this  correction  factor  adjusts  the  effectiveness  score  to 
reflect  a  loss  of  effectiveness  due  to  unnecessary  cost.  Where  a  theoretical 
device  concept  is  being  considered,  there  probably  will  be  no  tasks  unique  to 
it  and  the  correction  factor  is  not  used. 

K9)  Repeat  the  procedure  for  each  training  device  or  training 
device  concept  under  consideration. 


Thus  you  can  report  that  a  predicted  overall  highest  effectiveness  may  be  ex¬ 
pected  from  the  new  device,  C,  next  from  device  B  and  lowest  from  A.  These 
may  now  be  used  in  cost  effectiveness  analysis.  For  a  costing  methodology  se° 
Section  HID,  Costing  of  Training  Programs  -  The  Litton  Cost  Model  (p.  III-77). 
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Figure  III-25.  Example  Training  Device  Effectiveness  Index 
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5.  TCA.  Hawley  and  Thomason,  Development  of  an  Air  Defense  Cost  and 

Training  Effectiveness  Analysis  Methodology,  2  vol.,  1975. 

TCA  makes  use  of  a  computer  program,  but  before  you  use  it  you  will  need 
to  manually  prepare  the  input  data.  Instructions  with  the  program  will  tell  you 
how  to  input  the  data  you  have  prepared.  The  following  procedure  will  lead  you 
step  by  step  through  the  preparation  of  the  input  data  and  the  interpretation  of 
the  output  information. 

Preparation  of  Input  Data 

Step  1 .  You  will  need  a  nunber  of  TCA  Worksheets  equal  to  the  number 
of  tasks  you  are  considering  times  the  nunber  of  training  program  alternatives 
to  be  compared  (tasks  in  task  list  x  number  of  alternatives).  Thus,  if  you  were 
to  consider  twenty  tasks  and  three  different  training  program  alternatives,  you 
would  need  at  least  sixty  worksheets.  You  may  make  your  own  or  make  photocopies 
of  the  one  in  Appendix  1  of  Annex  E. 

Step  2.  Organize  the  tasks  you  are  going  to  consider  into  groups  of 
tasks  that  will  be  trained  together. 

Step  3.  For  each  task  prepare  a  separate  TCA  Worksheet  by  recording 
the  four-digit  task  nunber  at  the  top  of  the  sheet.  Record  the  identification 
of  the  training  program  alternative  also,  and  then  prepare  an  additional  work¬ 
sheet  for  each  additional  training  program  alternative.  That  is,  for  each  task 
you  will  prepare  a  worksheet  for  each  training  alternative  of  that  task.  See 
Figures  III-26  and  III -27. 

Step  4.  For  each  task  prepare  a  task  description  by  performing  the 
following  substeps: 

a.  Compare  the  task  with  each  of  the  stimuli  characteristics  given 
in  Annex  A  (TEEM).  On  the  worksheet  under  Stimulus  Characteristics,  and  under 
the  number  that  corresponds  to  the  number  of  the  stimulus  characteristic,  re¬ 
cord  a  "1”  for  each  characteristic  that  applies  and  a  ”0"  for  each  character¬ 
istic  that  does  not  apply.  See  Figures  III-26  and  III-27  for  examples.  Record 
these  same  numbers  on  each  worksheet  for  the  same  task.  (You  must  be  thoroughly 
familiar  with  the  task  and  have  a  valid  reason  for  including  a  variable  in  the 
description  of  it.  See  Appendix  2,  Annex  E  for  examples  of  reasons  for  inclu¬ 
ding  a  variable  in  a  task  description.) 

b.  Compare  the  task  with  each  of  the  response  characteristics  given 
in  Annex  A  (TEEM).  On  the  worksheet,  under  Response  Characteristics  and  under 
the  nunber  that  corresponds  to  the  number  of  the  response  characteristics,  re¬ 
cord  a  "1”  for  each  characteristic  that  applies  and  a  "0"  for  each  that  does 
not  apply.  See  Figures  III -26  and  III-27  for  examples.  Record  these  same 
numbers  on  each  worksheet  for  the  same  task. 

c.  Compare  the  task  with  each  of  the  information  feedback  logic  vari¬ 
ables  given  in  Annex  A.  On  the  worksheet,  under  Feedback  Logic  and  under  the 
number  that  corresponds  to  the  number  of  the  feedback  variable,  record  a  "1" 
for  each  feedoack  variable  that  applies  and  a  "0"  for  each  that  does  not  apply. 
See  Figures  III-26  and  III-27  for  examples.  Record  these  same  numbers  on  each 
worksheet  for  the  same  task. 


III-70 


TASK  DESCRIPTION 


Figure  III-26.  TCA  Worksheet 


TASK  DESCRIPTION 


Figure  III-27.  TCA  Worksheet 


d.  Compare  each  task  group  given  with  the  functional  context  variables 
given  in  Annex  A  (TEEM).  For  each  task  in  the  task  group,  under  the  number  that 
corresponds  to  the  number  of  the  functional  context  variable,  record  a  "I”  for 
each  variable  that  applies  and  a  "0"  for  each  that  does  not  apply.  See  Figures 
III-26  and  III-27  for  examples.  Record  these  same  numbers  on  each  worksheet  for 
the  same  task. 


Step  5.  For  each  training  program  alternative  of  each  task  prepare  a 
training  description  by  performing  the  following  substeps: 

a.  Search  through  the  list  of  training  equipment  and  materials  in 
Annex  A  (TEEM)  to  find  the  stimulus  media  of  each  alternative  training  program 
of  each  task.  (Stimulus  media  are  the  means  through  which  information  is  pre¬ 
sented  to  the  student.)  In  the  training  description  part  of  the  worksheet,  under 
Stimulus  Media,  record  the  number  of  the  media.  See  Figures  III-26  and  III-27. 
(You  must  be  thoroughly  familiar  with  each  training  program  alternative  so  that 
you  can  properly  identify  each  medium  employed  in  the  training  of  each  task.) 

b.  Search  through  the  list  of  training  equipment  and  materials  in 
Annex  A  (TEEM)  to  find  the  response  media  of  each  alternative  training  program 
of  each  task.  (Response  media  are  the  means  by  which  the  student  demonstrates 
that  he  has  learned;  they  are  the  things  on  which  the  student  acts  as  he  re¬ 
sponds.)  In  the  training  description  part  of  the  worksheet,  under  Response 
Media,  record  the  numbers  of  the  media.  See  Figures  III-26  and  III-27. 

c.  Search  through  the  list  of  training  equipment  and  materials  in 
Annex  A  (TEEM)  to  find  the  feedback  media  of  each  alternative  training  program 
of  each  task.  (Feedback  media  are  the  means  through  which  the  student  is  in¬ 
formed  of  the  correctness  of  his  response.)  In  the  training  description  part 
of  the  worksheet,  under  Feedback  Media,  record  the  number  of  the  media.  See 
Figures  III-26  and  III -27 . 

d.  Search  through  the  list  of  training  methodologies  in  Annex  A  (TEEM) 
to  find  the  training  methods  for  each  task  group  in  each  training  program  alter¬ 
native.  For  each  task  in  the  task  group,  record  the  numbers  of  the  methods  on 
the  worksheet  under  Methods .  See  figures  III-26  and  III-27. 

Step  6.  You  now  have  a  description  of  each  task  to  be  considered  and 
a  description  of  each  alternative  training  program  of  each  task.  Sort  the  TCA 
Worksheets  by  training  program  alternative.  Within  the  stack  of  worksheets 
representing  each  alternative  training  program  arrange  the  worksheets  by  task 
group.  When  you  are  finished,  you  will  have  a  stack  of  TCA  Worksheets  for  each 
training  program  alternative  you  are  examining.  Within  each  stack,  the  work¬ 
sheets  will  be  arranged  by  task  group. 

You  are  now  ready  to  go  to  a  computer  center  or  a  computer  terminal  to 
enter  your  data.  You  will  enter  a  separate  set  of  data  for  each  training  pro¬ 
gram  alternative  you  are  examining. 

Interpretation  of  the  Output  Information 

You  will  get  your  TCA  output  information  in  the  form  of  computer  print¬ 
out.  You  will  get  separate  pages  of  printout  for  each  training  program  alter¬ 
native.  You  will  interpret  the  output  information  by  performing  the  following 
steps: 


Step  1 .  (Refer  to  Figure  III -28.  The  format  of  the  printout  you  get 
may  not  be  exactly  like  that  given  in  Figure  III-28,  but  you  will  find  the  same 
information.)  First,  for  each  task  as  trained  by  each  alternative  training  pro¬ 
gram,  examine  the  information  indicated  by  0  in  Figure  III-28.  These  are  the 
85  task  description  nunbers  you  have  entered  for  the  task  (i.e.,  the  39  numbers 
of  stimulus  characteristics  plus  the  16  nunbers  of  response  characteristics  plus 
the  17  nunbers  of  feedback  logic  plus  the  13  nunbers  of  functional  context  equal 
85).  Compare  them  with  the  TCA  Worksheet  to  verify  that  they  are  correct.  Then 
check  the  information  indicated  by  (2)  in  Figure  III-28.  This  information  must 
include  the  nunbers  under  Training  Description  in  the  TCA  Worksheet .  In  the 
example  given  in  Figure  III-28,  programed  text  (8)  was  the  stimulus  medium,  the 
response  medium,  and  the  feedback  medium.  The  methods  were  performance-manual- 
independent  practice  (6)  and  programmed  instruction  (10). 

Step  2.  Examine  the  training  deficiencies,  redundancies,  and  excesses 
to  get  an  idea  of  the  nature  of  the  match  between  the  task  descriptions  and  the 
training  descriptions.  This  information  may  be  of  value  to  you  when  you  compare 
training  program  alternatives  and  recouinend  revisions.  (A  training  deficiency 
means  that  a  characteristic  in  the  task  description  is  not  matched  by  the  train¬ 
ing  description .  A  training  excess  means  that  there  is  a  capability  in  the 
training  description  not  required  by  the  task  description .  A  training  redun¬ 
dancy  means  that  two  or  more  media  or  methods  match  the  same  task  character¬ 
istics.)  The  nunbers  of  deficiencies,  excesses,  and  redundancies  are  indicated 
by  ©  in  Figure  III-28.  The  nine  deficiencies  (i.e.,  cnaracteristics  in  the 
taskdescription  that  are  not  matched  by  the  training  description)  are  indicated 
by  (5)  in  Figure  111-28.  TNcte  that  in  this  printout  task  characteristics  are 
numbered  sequentially  across  stimulus  characteristics,  response  characteristics, 
information  feedback  logic,  and  functional  context  —  39  +•  16  +  17  +  13  =85). 

See  Annex  A  (TEEM) .  The  two  redundancies  in  this  example  (5)  show  that  the 
two  methods  in  the  training  description  (6  and  10)  both  match  the  task  character¬ 
istics  shown  (75  and  81).  This  information  may  indicate  media  or  methods  that 
can  be  eliminated  from  the  training  program  without  harming  training  effective¬ 
ness.  The  7  training  excesses  in  the  example  in  Figure  III-28  are  indicated  by 
(6).  This  information,  too,  may  indicate  media  or  methods  that  can  be  elimi¬ 
nated  from  a  training  program  without  harming  training  effectiveness. 

Step_3j_  Examine  statistics  for  each  task  and  each  task  group.  In 
Figure  III-29,  (V)  indicates  the  statistics  by  task.  The  nunbers  in  the  row 
labeled  COINCIDENCES  show  how  many  matches  there  were  between  the  task  descrip¬ 
tion  and  the  training  description.  For  Task  3302,  for  example,  there  were  20 
matches  between  the  task  description  and  the  training  description.  The  nunbers 
in  the  row  labeled  TASK  SUM  show  how  many  task  characteristics  there  were  in 
the  task  description.  For  Task  3302,  for  example,  there  were  29  such  character¬ 
istics.  The  nunbers  in  the  row  labeled  CON.  RATIO  are  the  Training  Consonance 
Ratios  (TCR)  of  each  task.  The  TCR  is,  simply,  the  coincidences  over  the  task 
sum  (20/29  =  .687).  In  Figure  III-29  (2)  indicates  thi3  same  information  for 
a  whole  task  group.  Information  similar  to  that  indicated  by  (2)  in  Figure 
III-29  will  also  be  given  for  all  tasks. 

Step  4.  Establish  the  TCR  level  that  represents  acceptable  training 
effectiveness.  This  step  is  based  on  judgment  to  be  refined  by  experience,  but 
a  TCR  below  .600  should  probably  be  considered  to  represent  unacceptable  train¬ 
ing  effectiveness. 
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D.  Costing  of  Training  Programs  -  The  Litton  Cost  Model 


Introduction 


The  cost  factors  you  will  use  in  this  model  generally  fall  into  five 
categories: 

o  facilities  (classrooms,  laboratories,  learning  centers,  etc.) 

o  equipment  (projectors,  simulators,  learning  carrels,  etc.) 

o  instructional  materials  (texts,  films,  slides,  TEC  lessons,  etc.) 

o  personnel  (students,  instructors,  support  personnel,  etc.) 

o  miscellaneous  (ammunition,  POL,  parts,  other  consumable  supplies) 

The  cost  elements  that  make  up  these  categories  are  represented  by  FORTRAN 
names.  Each  is  defined  the  first  time  it  is  used.  There  is  also  a  Glossary  of 
Cost  Variables  as  Appendix  1  to  Annex  D. 

The  model  is  designed  to  estimate  the  training  costs  of  initial  training 
proficiency  on  the  system  under  study.  For  those  tasks  trained  to  proficiency 
in  the  institution,  proficiency  is  assumed  when  the  student  passes  his/her  end- 
of-course  tests.  For  those  critical  tasks  not  trained  in  the  institution  or 
trained  only  to  familiarity,  proficiency  is  assumed  when  the  soldier  success¬ 
fully  completes  the  appropriate  Skill  Qualification  Test  (SQT) .  Thus,  refresher 
training  or  unit  effectiveness  training  beyond  this  point  is  not  relevant  to 
this  model. 

Although,  the  model  can  develop  an  estimate  of  the  absolute  costs  of  a  sys¬ 
tem,  it  may  also  be  used  to  compare  costs  of  competing  systems.  In  the  latter 
case,  care  must  be  exercised  to  ensure  a  common  basis  for  comparison,  i.e.,  the 
same  cost  factors  are  considered  for  both  systems.  Since  the  CTEA  process  is 
dynamic  and  occurs  at  several  points  in  the  life  cycle  system,  the  amount  and 
type  of  input  data  will  vary.  Obviously,  you  can  expect  less  system  data  at 
the  early  stages  of  the  system  cevelopraent  process.  If  an  analogous  task  has 
been  identified,  then  the  cost  of  training  that  task  will  have  to  be  used  since 
it  has  been  chosen  because  data  on  the  developing  system  is  lacking.  You  may 
have  to  modify  the  analogous  task  data  on  the  basis  of  conmon  sense.  For  ex¬ 
ample,  if  you  are  studying  some  sort  of  laser  individual  weapon  and  find  an 
analogous  task  for  the  M16A1  rifle,  it  would  not  make  sense  to  use  the  cost  of 
the  M16A1  rifle  in  the  cost  computations.  Get  the  estimated  cost  of  the  laser 
weapon  from  its  Program/Project/Product  Manager  (PM),  potential  manufacturer(s) , 
or  from  a  laser  expert  and  use  it.  Further,  remember  that  you  are  costing  only 
those  units  required  for  initial  proficiency  training  —  not  for  equipping  the 
whole  Army.  If  there  is  insufficient  data  available  on  the  developing  system 
and  no  analogous  tasks  can  be  identified,  it  may  well  be  that  you  cannot  de¬ 
velop  the  cost  estimates.  However,  you  should  recognize  that  there  may  be  sub¬ 
ject  matter  or  other  experts  whose  estimates  of  costs  can  be  used  if  necessary. 
It  may  be  that  you  can  proceed  to  estimate  the  costs  without  certain  cost  fac¬ 
tors  that  are  unavailable.  Again,  you  should  ensure  comparability  of  factors 
between  competing  systems.  It  is  also  essential  that  you  explicitly  indicate 
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in  your  analysis  those  factors  that  have  been  emitted  until  data  become  avail¬ 
able.  You  can  expect  that  the  quality  and  quantity  of  the  data  will  be  up¬ 
graded  as  the  system  proceeds  through  its  development  stages  or  phases  of  its 
life  cycle. 

For  most  purposes  costs  in  thousands  of  dollars  to  the  nearest  hundred 
will  suffice,  e.g.,  $5,610  would  be  represented  as  $5.6.  However,  this  should 
be  governed  by  your  own  good  judgment  to  ensure  that  undue  effort  is  not  ex¬ 
pended  to  develop  accuracy  in  some  variables  that  is  not  justified  by  the  rough 
estimates  of  other  variables.  This  is  especially  important  in  the  early  stages 
of  development  of  the  system. 

Since  the  CTEA  methodology  considers  the  possible  use  of  analogous  tasks, 
there  is  another  important  caution.  The  following  cost  model  may  be  used  for 
estimating  the  costs  of  training  of  tasks  or  of  the  system.  When  using  the 
model  with  task  data,  the  system  costs  are  then  obtained  by  summing  the  costs 
of  the  tasks.  You  must  be  sure  that  you  consider  certain  costs  only  once  (e.g., 
cost  of  acquiring  training  equipment)  if,  in  fact,  the  equipment,  materials, 
etc.  required  for  these  costs  are  applicable  to  more  than  one  task. 

Procedures 

The  cost  model  is  intended  to  be  an  automated  model.  Examples  of  manual 
computations  have  been  included  in  the  text  to  help  you  develop  the  input  data 
for  the  model  and  to  further  explain  the  model.  In  some  cases  uou  will  note 
that  a  final  dollar  value  for  the  variable  is  not  shown.  These  computations 
are  incomplete  because  they  do  not  readily  lend  themselves  to  being  done  man¬ 
ually.  The  total  training  costs  of  concern  consist  of  the  initial  proficiency 
training  that  takes  place  in  the  institutions  or  schools  and  that  which  takes 
place  in  the  units .  This  is  represented  by  Equation  1 . 

TVALUE  =  I  VALUE  +  (JVALUE  ( 1 ) 

where 

TVALUE  =  total  costs  attributable  to  initial  training 
on  the  task  or  system  being  studied. 

IVALUE  =  the  total  costs  associated  with  institutional 
training  of  the  task  system. 

UVALUE  =  the  total  costs  associated  with  initial  pro¬ 
ficiency  training  in  the  ’unit,  i.e.,  until  the 
soldier  passes  the  appropriate  SQT.  For  those 
tasks  trained  to  proficiency  in  the  institution, 
this  variable  =  0. 

Institutional  training  costs  are  further  divided  into  base  training  (e.g., 
classroom,  learning  centers)  and  field  training  conducted  by  the  institution. 
This  is  shown  in  Equation  2. 

IVALUE  =  BVALUE  +  FVALUE  (2) 

where 
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BVALUE  =  the  total  training  costs  associated  with 
institutional  base  training. 


FVALUE  =  the  total  training  costs  associated  with 
institutional  field  training. 

By  substitution: 

TVALUE  =  BVALUE  +  FVALUE  +  UVALUE  (3) 


DOD  requires  that  costs  and  benefits  in  CTEA  type  analyses  be  in  terms  of 
present  value  (or  discounted)  form.  The  discount  rate  is  prescribed  as  10  per¬ 
cent.  Since  all  materials,  facilities,  and  equipment  acquired  fo"  training  may 
not  be  consumed  during  the  initial  proficiency  training  period,  there  will  be  a 
remaining  value  of  these  assets.  This  remaining  value  is  treated  as  a  reduction 
in  the  cost  of  the  alternative  for  which  the  use  of  the  assets  is  intended.  The 
fair  market  value  nay  be  determined  from  sale  price,  scrap  value,  or  alternative 
use  value.  Thus  the  present  value  (i.e.,  costs)  of  institutional  base  training 
is  given  by  Equation  4. 


N  BDACST(i) 

bvalue  =  £ - rrrr 

i=i  (i+d)u"i; 


BRVAST 

(1+d)N 


(4) 


where 


BDACST(i)  =  the  total  institutional  base  training 
non-discounted  costs  for  the  year  i. 

The  notation  (i)  following  a  variable 
name  indicates  that  that  particular 
variable  may  have  a  value  which  changes 
from  year  to  year,  since  i  represents 
the  year  measured  from  "today". 

BRVAST  =  the  total  remaining  value  of  materials, 
facilities,  and  equipment  at  the  end  of 
the  planning  period  (N  years) . 

N  =  the  number  of  years  in  the  planning 

horizon  or  life  cycle  of  the  system.  If 
it  is  expected  that  training  to  initial 
proficiency  on  the  task  or  system  will 
continue  for  10  years,  for  example,  then 
N=10. 


d  =  discount  rate  (DOD  Instruction  7041.3 

prescribes  10  percent). 

Equation  4.1  is  the  basic  constitutive  equation  reflecting  the  breakdown 
of  costs  into  associative  element  costs. 


BDACST(i) 

where 

BFACOS(i) 


BFMCOS(i) 

BEAQCI(i) 

BEMQCI(i) 

BACIMD(i) 

BAIMMC(i) 


BFACOS(i)  +  BFMCOS(i)  +  BEAQCI(i)  (^ . 1 ) 

+  BEMQCI(i)  +  BACIMD(i)  +  BAIWC(i) 

+  BSUPPY(i)  -t-  BCINST(i)  +  BPALST(i) 

+  BTRANS(i) 


cost  of  institutional  base  training  facility- 
acquisition  in  year  i,  attributable  to  training 
the  particular  task  or  system.  If  a  facility 
i3  to  be  shared,  take  a  pro  rate  share  based  on 
ratio  of  the  students  being  trained  on  the  task 
or  system  being  studied  to  the  total  number  of 
students  using  the  facility.  In  the  case  of 
existing  facilities  the  costs  of  which  have 
been  amortized  and  there  is  no  alternative 
planned  use  for  the  facility  or  if  no  facilities 
need  to  be  acquired,  the  factor  BFACOS(i)  =  0. 

In  the  case  of  an  existing  facility  whose  costs 
are  not  amortized  or  for  which  there  are  alter¬ 
native  uses  or  possible  sale,  the  imputed  value 
of  the  facility  should  be  used.  These  costs  can 
be  based  on  fair  market  value,  scrap  value,  or 
alternative  use.  In  any  event,  discuss  this 
variable  with  the  Director  of  Industrial  Opera¬ 
tions  (DIO)  who  can  probably  give  you  good  advice 
and  cost  data  for  this  variable. 

You  should  also  examine  any  TRADOC  Form  124-R, 
Resource  Summary  Supplement ,  Other  Requirements , 
submitted  to  TRADOC  in  accordance  with  TRADOC 
Circular  35 1 —3  >  Training  Requirements  Analysis 
System  (TRAS) ,  Individual  Training  Plan  (ITP) 
(Figure  1).  These  forms  show  projected  MCA  and 
OMA  minor  construction  costs. 

total  cost  of  institutional  base  training 
facilities  maintenance  in  year  i. 

total  cost  of  institutional  base  training 
equipment  acquisition  in  year  i 

total  cost  of  institutional  base  training 
equipment  maintenance  in  year  i 

total  cost  of  institutional  instructional 
material  development  in  year  i 

total  cost  of  maintenance  of  institutional 
instructional  material  development  in  year  i 


Ill-bO 


BFACOS(i)  =  cost  of  institutional  base  training  facility  acquisition  in  year  i 
attributable  to  training  the  particular  task  or  system 


EXAMPLE: 

New  facilities  are  not  required  to  train  this  task  but  two 
existing,  vacant  maintenance  sheds  will  be  modified  by  constructing 
partitions  and  moving  electrical  outlets.  The  DIO  estimates  the 
cost  per'  shed  will  be  $1500.  But  this  modified  facility  will  be 
used  to  train  three  other  tasks  of  the  system  as  well.  The  per- 

I 

|  centage  of  time  that  it  will  be  used  to  teach  the  particular  task 
we  are  interested  in  is  .25. 

BFACOS(i)  =  .25  •  $1500  •  2  =  $750  =  $ .8  (thousands)* 


•The  symbol  •  means  "multipled  by.”  Do  not  confuse  with  decimal  point. 
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TRADOC  Cir  351-3 


RESOURCE  SUMMARY  SUPPLEMENT 
OTHER  REQUIREMENTS 

(TRADOC  Ci»  1*1 -1) 


MCA  PROJECT/OMA  MINOR  CONSTRUCTION 


Project  No  I  Description  Date  Required  1  Cost 


TRADOC  J0*'.'!  1 24-R  ••«>* 

■  * 


Figure  1. 
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BSUPPY(i)  =  total  cost  of  supplies  consumed  in  year  i  in 
institutional  base  training 

BCINST(i)  =  total  cost  of  pay  and  allowances  of  all  in¬ 
structors  in  institutional  base  training  in 
year  i 


BPALST(i)  =  total  cost  of  pay  and  allowances  of  students 
in  institutional  base  training  in  year  i 


BTRANS(i)  =  total  cost  of  travel  (including  per  diem)  and 
equipment  transportation  in  connection  with 
institutional  training  in  year  i,  and 


The  variables  in  Equation  4.1  are  further  defined  as  follows: 


BFMCOS(i)  =  BTSQFT(i)  •  BCSQFT(i)  (4.11) 

where 

BTSQFT(i)  =  total  square  feet  of  institutional  base  training 
facilities  required  in  year  i 

BCSQFT(i)  =  cost  per  square  foot  of  operation  and  maintenance 
of  training  facilities  in  year  i  (includes  opera¬ 
tion,  janitorial  services,  utilities,  etc.). 

Either  the  DIO  or  Director  of  Facilities  Engineer¬ 
ing  at  your  installation  should  be  able  to  furnish 
data  on  this  item. 


and  where: 

BTSQFT(i)  =  [ BSQFST  +  BINSTR  .  SQFTIN]  .  MESL(i)  +  BSQFTA  (4.111) 

where 


BSQFST  =  number  of  square  feet  of  institutional  base  training 
facilities  required  for  each  student  (assumed  constant 
over  entire  planning  period).  Possible  sources  of 
data  are  the  DIO,  the  Management  Analysis  Division, 
and  input  data  to  TRADOC  Form  273-R  (Figure  2)  submitted 
in  accordance  with  TRADOC  Reg  11-12.  In  the  absence 
of  any  other  better  data,  you  could  use  an  average  ' 
figure  of  44  sq  ft  per  student  for  classroom  space; 

95  sq  ft  per  student  for  laboratory  space,  and  68  sq 
ft  per  student  for  combination  classroom/ laboratory 
space . * 


•Adapted  from  data  in  Hess  and  Kantar,  MODIA:  Vol.  5,  A  User’s  Guide  to  the 
Cost  Model. 
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BTSQFT(i)  =  total  square  feet  of  institutional  base  training  facilities  required 


in  year  i 

=  [BSQFST  +  (BINSTR  •  SQFTIN ) ]  •  MESL(i)  +  BSQFTA 


EXAMPLE: 

The  DIO  informs  you  that,  for  this  task,  the  number  of  square 
feet  required  per  student  (BSQFST) 'is  80  and  the  number  of  square 
feet  per  instructor  (SQFTIN)  is  60. 

The  Management  Analysis  Division  tells  you  that  the  ratio  of 
instructors  to  students  (BINSTR)  for  this  task  is  1:10  or  .1  and 
the  maximum  expected  student  load  (MESL(i))  is  20. 

The  DIO  also  estimates  the  total  square  feet  of  administrative 
space  (BSQFTA)  attributable  to  training  this  system  as  100.  DTD 
has  told  you  that  training  this  task  will  take  25  percent  of  the 
system  training  time. 

BTSQFT(i)  =  [80  +  (.1  •  60)]  •  20  +  (100  •  .25) 

=  86  •  20  +  25 

\ 

=  1745  sq.  ft.  *j 

> 

:  \ 


i  • 

.  i 

0 
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BFMCOS(i)  =  total  cost  of  institutional  base  training  facilities  maintenance 


in  year  i. 

s  BTSQFT(i)  •  BCSQFT(i) 


EXAMPLE: 

The  total  square  feet  of  facilities  for  this  task  has  been 
computed  as  1 7U5  square  feet. 

The  Director  of  Facilities  Engineering  informs  you  that  he 
uses  a  constant  maintenance  cost  per  square  foot  of  $2.00  per 
year  (for  janitorial  services,  utilities,  and  general  upkeep). 

BFMCOS(i)  =  1745  •  2  =  $3490  =  $3.5  (thousands) 
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figure  of  44  sq  ft  per  student  for  classroom  space; 

95  sq  ft  per  student  for  laboratory  space,  and  68  sq 
ft  per  student  for  combination  classroom/ laboratory 
space.* 

BINSTR  =  ratio  of  instructors  to  students  in  institutional  base 
training  (assumed  constant  from  year  to  year).  These 
data  should  be  available  in  school  Management  Analysis 
Division  or  similar  office  or  Director  of  Instruction. 

SQFTIN  =  nunber  of  square  feet  of  facilities  required  per 
instructor  (assumed  constant) .  See  sources  for 
BSQFST  above. 

BSQFTA  =  total  square  feet  of  facilities  required  for  administra¬ 
tion  associated  with  initial  training  on  the  system. 

See  sources  for  BSQFST  above. 

MESL(i)=  maximum  expected  student  load  in  year  i. 

BEAQCl(i)  =  BEQIMP(i)  •  MESL(i)  +  BEQCIS(i)  (4.12) 

where 

BBQIMP(i)  =  cost  per  student  of  the  variable-cost  institutional 

base  training  equipment  that  must  be  acquired  in  year  i. 
Variable-cost  resources  relate  directly  to  workload  and 
change  as  the  workload  level  changes  over  a  relevant 
range.  Refer  to  TRADCC  Form  811-R,  TRADOC  Equipment 
Data  (Figure  3) ,  submitted  in  accordance  with  TRADOC 
Reg  11-5.  The  Audio-Visual  Equipment  Directory  is  also 
useful  in  this  respect.* 

BEQCIS(i)  =  total  cost  of  fixed-cost  institutional  base  training 
equipment  acquired  in  year  i.  Fixed-cost  (or  static) 
resources  are  not  responsive  to  changes  in  the  work¬ 
load  (such  as  nimber  of  students)  over  a  relevant 
range.  You  should  check  data  submitted  to  TRADOC 
in  accordance  with  TRADOC  Reg  11-5  and  TRADOC  Cir. 

351-3.  TRADOC  Form  811-R  (Figure  3)  was  mentioned 
above  under  BEQIMP(i).  The  Individual  Training  Plan 
Proposal  (ITPP)  will  list  any  projected  new  or  re¬ 
vised  extension  products  by  type  (e.g.,  TEC).  TRADOC 

Form  1 25— R ,  Resource  Summary  FY  _ ,  will  identify 

by  fiscal  year  by  element  of  expense  (EOE)  the  OMA 
dollars  required  (Figure  4).  TRADOC  Form  124-R  will 
show  requirements  for  major  equipment  items  not  funded 
from  the  OMA  appropriation  (Figure  1).  Training  Aids 
Service  Offices  (TASO)  are  also  possible  sources  for 
data  as  well  as  PM  TRADE. 

BEM2CI ( i )  -  BCOPMT(i)  •  SI(i)  +  BOMFEQ(i)  (4.13) 

where 
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BEAQCI(i)  =  total  cost  of  institutional  base  training  equipment  acquisition 


in  year  i. 

=  BEQIMP(i)  •  MESL(i)  +  BEQCIS(i) 


% 


£ 
4  ' 


IS 


EXAMPLE: 

In  order  to  train  this  task  each  student  will  have  a  Beseler 
Cue/See.  TRADOC  Form  811-R,  TRADOC  Equipment  Data  shows  that  the 
acquisition  value  is  $14,300  (20  students  +  10  percent  spares  = 

22  units  at  $b50  each).  TRADOC  Form  811-R  also  shows  two  35mm 
projectors  at  a  total  acquisition  value  of  $1250  are  required  for 
training  the  system.  Since  training  this  task  takes  25  percent 
of  the  course  time, 

BEAQCI(i)  =  14,300  +  1250  •  .25 
=  14,300  +  312.50 
=  $14.6  (thousands) 

You  are  also  advised  by  the  TASO  that  you  should  count  on  re¬ 
placing  the  Beseler  Cue/See  beginning  in  the  seventh  year  at  a 
rate  of  10  percent  per  year.  Your  planning  period  (N)  =  10  years. 
Thus  the  BEQIMP(i)  •  MESL(i)  costs  over  10  years  are 


Year 

1 

2 

3 

a 

5 

6 

B 

8 

9 

10 

BEQIMP(i) « 
MESL(i) 

_ 

0 

0 

0 

B 

1300 

1300 

HI-88 


BEM3CI(i)  =  total  cost  of  institutional  base  training  equipment  maintenance 


in  year  i 

=  BCOPMT(i)  •  SI(i)  +  BOMFEQ(i) 


EXAMPLE: 

The  TASO  advises  you  that  maintenance  for  fielded  Cue/See 
will  cost  $10  per  unit  for  the  first  six  years  and  $40  per  unit 
per  year  after  six  years.  Thus  for  years  1-6  the  cost  is  22 
$10  =  $220.  Starting  in  the  seventh  year  10  percent  of  the  units 
(22  •  .10  =  2)  will  be  replaced  each  year  so  maintenance  cost 
will  be  (20  •  $40  +  2  •  $10  =  $820)  for  year  seven.  The  N=10 
year  matrix  is  as  shown. 


Year 

1 

2 

3 

■ 

5 

— 

6 

B 

8 

9 

10 

BCOPMT(i) 

•  SI(i) 

220 

220 

220 

220 

320  |  760 

_ 1 _ 

700 

640 

The  maintenance  costs  for  the  projectors  are  reported  as  $20 
per  year  for  both  or  $200  for  the  10-year  period,  prorated  for 
this  task  is  $200  x  .25  =  $50. 
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ZUI 


COST  AND  ANALYSIS  P*OG*AN 
(HOS  T»»*r»»«g  Costt) 
(TRAOC  C  ll-S) 


N*  n*  loction  o»  aTC  or  Set 


T*AOOC  equipment  DATA 


Q  ATC 

L  _  1  School 


Nc-TE  The  Af^uitifion  ^t!j«  *►  >u.o  not  be  -.dent tfttd  by  court#  unifii  :h»i  piece  -rf  e^utpmeni  fen  be  poaj!i»e!v 

identified  •#  only  cne  course. 
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BCOPMT(i)  =  cost  per  student  of  maintenance  of  variable-cost 

institutional  base  training  equipment  in  year  i.  The 
TASO  may  have  data  that  will  help  with  this  variable 
as  may  PM  TRADE. 

BOMFEQ(i)  =  cost  of  operation  and  maintenance  of  fixed-cost 
institutional  base  training  equipment  in  year  i. 

The  TASO  may  be  able  to  furnish  data  on  this 
variable  as  may  PM  TRADE. 

SI(i)  =  average  number  of  students  (total  input  +  total  output) 

2 

in  institutional  training  for  this  system  in  year  i. 

BACIMD(i)  =  BCIMD  •  R  •  MESL(i)  (4.14) 

where 

BCIMD  =  cost  per  student  in  year  i  for  instructional  material 
development.  Sec  TRADOC  Form  858-R,  TRADOC  Schools 
Mission  Data  by  Function/Organization  (Figure  5)  sub¬ 
mitted  in  accordance  with  TRADOC  Reg  11-5. 

R  =  number  of  repetitions  of  the  course  in  year  i  (assumed 
constant) . 

BAIMMC(i)  =  BCUIMD  •  SI(i)  (4.15) 

where 

BCUIMD  =  average  annual  cost  per  student  for  maintenance  of 

instructional  material.  (This  cost  is  assumed  constant 
but  could  be  made  variable  on  a  yearly  basis  by  inserting 
the  appropriate  yearly  value  where  used.)  The  Management 
Analysis  Division  or  DTD  should  have  experience  factors. 

BSUPPY(i)  =  BSUPLY(i)  •  SI(i)  (4.16) 

where 

BSUPLY(i)  =  cost  per  student  of  institutional  base  supplies 

consumed  in  year  i.  See  TRADOC  Form  858-R  (Figure  4), 

TRADOC  Schools  Mission  Data  by  Function/Organization 
submitted  in  accordance  with  TRADOC  Reg  11-5. 

BCINST(i)  =  [BPALIN(i)  •  BINSTR  •  MESL(i)  +  BOVERH(i)  •  BRORAT(i) 

•  SI(i)]  •  BTIME  (4.17) 

where 

BPALIN(i)  =  average  annual  pay  and  allowances  of  an  instructor  in 
institutional  base  training  in  year  i.  Compute  this 
in  accordance  with  Section  III ,  TRADOC  Resources  Fac¬ 
tors  Handbook. 
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BACIMD(i)  =  total  cost  of  institutional  instructional  material  development  in 


year  i. 

=  BCIMD  •  MESL(i)  «  R 


EXAMPLE: 

DTD  has  developed  the  following  data  on  the  system  course 
as  input  to  TRADOC  Form  858-R,  TRADOC  Schools  Mission  Data  by 
Function/Organization . 

For  training  this  particular  task,  three  (3)  TEC  lessons 
will  be  developed  at  a  cost  of  $12,000  per  lesson.  Reproduction 
costs  will  be  $3000. 

DTD  has  determined  that  manpower  costs  for  instructional 
material  development  for  the  course  =  $192,000.  This  task's 
pro  rata  share  =  .25  •  192,000  =  $98,000. 

Notwithstanding  the  equation  given  above,  these  data  lend 
themselves  to  direct  computation  of  BACIMD(i)  as  follows: 

BACIMD(i)  =  (3  •  12,000)  +  3000  +  48,000 
=  $87000  =  $87  (thousands) 
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BAIMMC(i)  =  total  cost  of  institutional  instructional  material  in  year  i 
=  BCUIMD  •  sr(i) 

EXAMPLE: 

DTD  informs  you  that  they  use  a  factor  of  20  percent  of  the 
development  costs  to  compute  maintenance  costs  for  instructional 
materials.  Again,  it  is  easier  to  compute  BAIMMC(i)  directly 
without  having  to  use  the  equation. 

EAIMMC(i)  =  .20  •  87000  =  $17.4  (thousands) 


BSUPFY(i)  =  total  cost  of  supplies  consumed  in  year  i  in  institutional  base 


training 

=  BSUPLY(i)  •  SI( i) 


EXAMPLE: 

You  ask  the  Director  of  Instruction  how  he  computed  the 

entry  for  column  c  of  TRADOC  Form  85b-R.  You  find  his  input 

for  base  supplies  was  based  on  $3.00  per  student  for  the 

course  you  are  interested  in.  The  average  number  of  students 

(.total  input  +  total  output)  trained  on  the  system  during 
2 

year  i  =  200.  Again,  note  this  task  takes  25  percent  of  the 
total  training  time. 

BSUPPY ( i )  =  $3.00  •  200  •  .25  =  150  =  .2  (thousands) 
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BCINST(i)  =  total  cost  of  pay  and  allowances  of  all  instructors  in  institutional 
instructional  base  training  in  year  i 

=  CBPALIN(i)  •  BINSTR  •  MESL(i)  +  BOVERH(i)  •  BRORAT(i)  •  SHi)] 

•  BTIME 


EXAMPLE: 

In  order  to  compute  BPALIN(i)  (average  annual  pay  and  allow¬ 
ances  of  an  instructor  in  institutional  base  training  in  year  i), 
you  obtain  the  latest  military  (and  civilian,  if  needed)  pay  scales. 
You  obtain  from  the  Department  of  Instruction  the  numbers  of  in¬ 
structors  by  grade  who  will  train  the  task.  By  using  the  metho¬ 
dology  on  page  35  in  Section  III  of  the  TRADOC  Resource  Factor 
Handbook  (7  December  197b),  you  determine  the  average  pay  and  al¬ 
lowances  of  an  instructor  is  $19,400  =  $19.4  (thousands).  You 
have  determined  earlier  the  BINSTR  for  this  task  is  . 1 .  The  De¬ 
partment  of  Instruction  indicates  that  the  student  input  for  year 
i  will  be  22259.  You  see  from  TRADOC  Form  858-R,  lines  6,  7,  and 
d  and  column  f  that  total  overhead  expenses  are  $3,059,700.  By 
dividing  this  by  number  of  students  the  overhead  per  student  = 
$137.46  =  BOVERH(i).  BRORAT(i)  =  ratio  of  average  number  of  stu¬ 
dents  training  on  this  task  in  year  i  to  total  number  of  students 

in  institutional  base  training  in  year  i  =  200  =  .009. 

22259 

The  system  course  is  4  weeks,  of  which  3  weeks  are  base 
training  and  one  week  is  field  training.  There  are  12  repetitions 
of  the  course  per  year. 

BTIME  =  3b  =  .75 
46 

BCINST(i)  =  C(.1  •  19440  •  20)  +  (137.46  •  .009  •  200)] 

•  .75  •  .25  =  (3b&eo  +  247.49)  •  .75  •  .25  = 

733b  =  $7.3  (thousands) 


r 


BOVERH(i)  =  cost  per  student  of  institutional  base  operations  over¬ 
head  in  year  i.  These  data  may  be  available  from  the 
TRADOC  Form  858-R,  TRADOC  Schools  Mission  Data  by 
Function/Organization  (Figure  5),  submitted  in  accor¬ 
dance  with  TRADOC  Reg  11-5.  Also  check  the  Center/ 
School  Management  Analysis  Division  or  Program  and 
Budget  Division  or  other  office  responsible  for  these 
functions. 


BRORAT(i)  =  Ratio  of  average  number  of  students  in  initial  training 
on  the  particular  system  to  average  total  nunber  of 
students  in  institutional  base  training  in  year  i. 


BTIME 


=  fraction  of  year  spent  by  each  student  in  institutional 
base  training. 


BPALST(i)  =  ASTUPA(i)  •  BTIME  .  SI(i) 


(4.18) 


where 


ASTUPA  =  average  annual  pay  and  allowances  of  students  in  year  i. 

Compute  this  in  accordance  with  Section  III,  TRADOC  Re¬ 
sources  Factor  Handbook. 

BTRANS(i)  =  BTRAVL(i)  «  SI(i)  +  BEQTRS(i)  (4.19) 

where 

BTRAVL(i)  =  cost  per  student  for  travel  (including  per  diem)  in 

connection  with  institutional  base  training  in  year  i. 
Compute  this  in  accordance  with  Section  III,  TRADOC 
Resources  Factor  Handbook.  May  also  be  obtained  from 
inputs  to  column  d  of  TRADOC  Form  858-R. 

BEQTRS(i)  =  cost  for  transportation  of  equipment  used  in  institu¬ 
tional  base  training  in  year  i.  Compute  this  in 
accordance  with  Section  III,  TRADOC  Resources  Factor 
Handbook. 

N 

BRVAST  =  T'  (BFACOS(i) ]  •  il-(FAD)  (N-i+1] 
i=1 

+  [BEAQCI(i)]  •  [l-(EAD)  (N-i+1] 

+  [BACIMD(i)]  •  Cl-(IAD)  (N-i+1)]  (4.2) 


FAD  =  annual  depreciation  rate  of  facilities  (assumes  straight- 
line  depreciation).  The  DIO  should  be  able  to  give  you 
the  depreciation  rate. 


where 


BPALST(i)  =  total  cost  of  pay  and  allowances  of  students  in  institutional 
base  training  in  year  i 

=  ASTUPA(i)  •  SICi)  •  BTIME 

EXAMPLE: 

The  Office  of  Management  gives  you  a  breakdown  of  numbers  of 
students  by  grade  of  students  training  on  the  system  per  year.  By 
using  page  35  in  Section  III  of  TRADOC  Resource  Factor  Handbook 
(7  December  1979),  you  determine  the  average  pay  and  allowances  of 
a  student  (ASTUPA(i))  is  $10,128.  The  system  course  is  four  weeks 
of  which  3  are  base  training. 

BPALST(i)  =  10128  •  200  •  3  •  .25  =  $379, 800  =  $379.8  (thousands) 

4 


BTRANS(i)  =  total  cost  of  travel  (including  per  diem)  and  equipment  transpor¬ 
tation  in  connection  with  institutional  training  in  year  i 

=  BTRAVL(i)  •  SI(i)  +  BEQTRS(i) 

EXAMPLE: 

The  Office  of  Management  tells  you  that  the  average  one  way 
mileage  used  for  cost  estimation  for  the  course  is  700.  Using 
Section  III  (page  46)  of  the  TRADOC  Resource  Factor  Handbook,  you 
find  the  factor  for  air  travel  is  $.1176. 

BTRAVL(i)  =  .1176  •  700  =  82.72 

BTRAVL(i)  •  SI(i)  •  .25  =  82.32  •  200.25  =  44,116 

You  will  have  to  compute  costs  for  1/2  ton  of  Besseler  Cue/ 

See  and  tapes  from  the  depot  —  a  distance  of  1000  miles.  Again 
using  Section  III  (page  43)  of  TRADOC  Resource  Factor  Handbook. 

BBQTRS(i)  =  .5  •  .0568  •  1000  =  $28.40 
BTRANS(i)  =  $4,118  +  $28.40 
BTRANS(i)  =  $4.1  (thousands) 


BRVAST  =  remaining  value  of  facilities,  equipment,  and  instructional  materials 


at  end  of  planning  period  (N  years) 


N 

=  X  [BFACOS(i) ]  •  [l-(FAD) (N-i+1 ) ]  + 
i=1 

[BEAQCI(i)]  •  [l-(EAD) (N-i+1)]  + 
[BACIMD(i) ]  •  tl-(IAD) (N-i+1)] 


i- 


i 

t 


n 


EXAMPLE: 

The  DIO  informs  you  that  the  two  maintenance  sheds  that  will 
be  used  for  the  course  are  fully  depreciated.  You  set  FAD  as  1 
1100%).  Therefore  [BFACOS(i)]  •  [l-(FAD)(N-i+1 ) ]  =  0. 

The  TASO  recorrmends  a  ten  percent  depreciation  rate  be  used 
for  the  combined  Cue/See  and  35  mn  projectors.  Thus,  EAD  =  .10. 

DTD  tells  you  they  do  not  intend  to  revise  the  TEC  lessons  i 
during  the  planning  period.  The  TASO  suggests  a  10  percent  depre¬ 
ciation  rate  on  the  tapes.  Thus,  I AD  =  .10. 


!i 
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EAD  =  annual  depreciation  rate  of  equipment  (assumes  straight- 
line  depreciation).  The  DIO  and/or  the  TASO  (for  training 
aids)  should  be  able  to  furnish  these  data.  The  Audio- 
Visual  Equipment  Directory  will  also  give  data  on  useful 
life  of  such  equipment. 

IAD  =  annual  depreciation  rate  of  instructional  materials  ( assumes 
straight-line  depreciation).  The  following  table*  can  be 
used  to  derive  the  depreciation  rate  depending  on  the  type 
of  instructional  materials. 


Courseware  Type 

Estimated  Useful  Life  (In  Years) 

Videotape 

1  to  5  years  depending  on  use 

Audiotape 

1  to  10  years  depending  on  use 

Film 

2  to  5  years  depending  on  use 

Filmstrip 

Unknown 

Photos 

Indefinite 

Slides 

Indefinite 

Transparencies 

Indefinite 

Printed  material 

Indefinite 

Charts,  maps 

Indefinite 

Microfiche 

Indefinite 

Microfilm 

Unknown 

Record 

1  to  5  years  depending  on  use 

Turning  to  the  field  training  conducted  at  the  institution: 


N 

FVALUE  =  2 
i=1 


FDCAST(i) 


(i+d) 


TT-TT 


FRVAST 

oTd? 


where 

FDCAST(i)  =  total  non-discounted  cost  of  institutional  field 
training  in  year  i,  and 


FRVAST  =  remaining  value  of  equipment  and  instructional 

materials  used  in  institutional  field  training  at 
end  of  planning  period. 


(5) 


FDACST(i)  =  FEAQCI(i)  +  FEMQCI(i)  +  FSUPPY(I)  +  FCINST(i)  +  FPALST(i) 

+  FPATRS(i)  +  FTRANS(i)  (5. 

•From  Hess  and  Kantar,  MODI A:  Vol.  5,  A  User's  Guide  to  the  Cost  Model. 
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where 

FEAQCI(i)  =  total  cost  of  acquisition  in  year  i  of  equipment  re¬ 
quired  for  institutional  field  training, 

FEM3CI(i)  =  total  cost  in  year  i  of  operation  and  maintenance  of 
equipment  required  for  institutional  field  training, 

FSUPPY(i)  =  total  cost  of  supplies  consumed  in  year  i  in  insti¬ 
tutional  field  training, 

FCINST(i)  =  total  cost  of  pay  and  allowances  in  year  i  of 

instructors  of  institutional  field  training,  and 

FPALST(i)  =  total  cost  of  pay  and  allowances  in  year  i  of 
students  in  institutional  field  training. 

FPATRS(i)  =  total  cost  of  pay  and  allowances  of  troop  support 

(P8  or  P2)  in  year  i  for  institutional  field  training. 

FTRANS(i)  =  total  cost  of  transportation  in  year  i  for  equipment 
and  material  used  in  institutional  field  training. 

These  variables  are  further  defined  as  follows: 

FEAQCI(i)  =  FEQIMP(i)  *  SI(i)  +  FEQCIS(i)  +  FEQTRS(i)  (5.11) 

where 

FEQIMP(i)  =  cost  per  student  of  variable-cost  institutional 
field  training  equipment  that  must  be  acquired 
in  year  i.  See  data  source  comment  for  BEQIMP(i). 

FEQCIS(i)  =  total  cost  of  fixed-cost  institutional  field 

training  equipment  acquired  in  year  i.  See  data 
source  comment  for  BEQCIS(i) . 

FEQTRS(i)  =  total  cost  of  equipment  of  troop  support  units 
attributable  to  training  this  task. 

FEM3CI(i)  =  FCOPMT ( I )  •  SI(i)  +  FOMFEQ(i)  +  FOMTRS(i)  (5.12) 

where 

FCOPMT(i)  =  cost  per  student  of  maintenance  of  variable-cost 
institutional  field  training  equipment  in  year  i. 

See  data  source  comment  for  BCOPMT. 

FOMFEQ(i)  =  cost  of  operation  and  maintenance  of  fixed-cost 

institutional  field  training  equipment.  See  data 
source  conment  for  BQMFEQ. 

POMTFS(i)  =  cost  of  operation  and  maintenance  of  troop  support 
equipment  attributable  to  training  this  task. 
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FEAQCI(i)  =  total  cost  of  acquisition  in  year  i  of  equipment  required  for  in¬ 
stitutional  field  training 

=  FEQIMP(i)  •  SI(i)  +  FEQCIS(i)  +  FEQTRS(i) 

EXAMPLE: 

Although  no  equipment  for  field  training  of  this  task  must 
be  acquired,  DTD  tells  you  that  one  week  of  the  four  week  course 
will  be  field  training  on  equipment  and  with  troops  of  a  school 
troop  (P8)  battery.  You  see  from  TRADOC  Form  858-R  (column  C) 
that  the  total  value  of  equipment  on  hand  in  the  battery  is  $51 ,000 . 

As  previously  determined,  training  this  task  represents  .25  of  the 
training  time  on  the  system.  Field  training  represents  .25  of 
course  time  and  1  week  -  48  weeks  of  the  school  year.  There  are 
12  repetitions  of  the  course  during  the  year.  Thus, 

FEQTRS(i)  =  51,000  «  1  •  .25  •  12  =  $3187.50 

W 

FEAQCI(i)  =  $3.2  (thousands) 
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FEM3CI(i)  =  total  cost  in  year  i  of  operation  and  maintenance  of  equipment 
required  for  institutional  field  training 

=  [FCOPMT(i)]  •  SI(i)  +  FOMFEQ(i)  +  FOMTRS(i) 

EXAMPLE: 

The  battery  of  school  troops  (P8)  tells  you  that  the  battalion 
is  using  a  figure  of  $2500  per  year  for  operation  and  maintenance 
of  the  battery  equipment.  Thus, 

FEMOCICi)  =  $2500  •  12  •  .25  =  $156.25  =  $.2  (thousands) 


FSUPPY(i)  =  [FPETRO(i)  +  FAMMO(i)  +  FCONSU(i)]  •  SI(i) 


(5.13) 


where 


FPETRO(i) 


FAMMO(i) 


FCONSU(i) 


FCINST(i) 

where 

FPALIN(i) 


FTIME 

FPALST(i) 

FPATRS(i) 

where 

APATRS 


FRVAST  = 


=  cost  per  student  of  petroleum  products  (POL)  con¬ 
sumed  in  institutional  field  training  in  year  i. 

The  DIO  should  have  data  on  this  item. 

cost  per  student  of  ammunition  expended  in  institu¬ 
tional  field  training  in  year  i.  See  TRADOC  Form 
810-R,  TRADOC  Ammunition  Costs  (Figure  6)  suhmitted 
in  accordance  with  TRADOC  Reg  11-5  and  the  Training 
Ammunition  Management  Information  System  (TAMIS). 

=  cost  per  student  of  miscellaneous  consumables  con¬ 
sumed  in  institutional  field  training  in  year  i. 

See  data  source  comment  for  BSUPLY(i). 

=  FPALIN(i)  •  FINSTR  •  FTIME  •  MESL(i)  (5.14) 


=  average  annual  pay  and  allowances  of  an  instructor 
in  institutional  field  training  in  year  i.  Compute 
these  in  accordance  with  Section  III,  TRADOC  Resources 
Factor  Handbook. 

=  fraction  of  year  spent  by  each  student  in  institutional 
field  training. 

=  ASTUPA(i)  «  FTIME  •  SI(i)  (5.15) 

=  APATRS(i)  •  FTIME  (5.16) 


=  annual  pay  and  allowances  of  troop  support  (P8  or  P2) 

P2  unit  costs  are  incurred  whether  the  unit  trains  or 
not  or  assists  in  training  or  not.  Nevertheless,  in 
costing  alternative  training  programs,  it  may  be  useful 
to  include  these  costs  where  they  differ  significantly 
among  alternatives.  You  may  find  troop  support  personnel 
costs  in  column  g  of  TRADOC  Form  858-R  or  from  the  unit 
or  compute  them  using  Section  III  of  TRADOC  Resource 
Factor  Handbook. 


I 

i  -1 


[FEAQCI(i) ]  •  [l-(EAD)(N-i+1 ) ] 


(5.2) 


Turning  to  the  training  conducted  in  the  Program  2  units  (only  if  the  task 
is  not  trained  to  proficiency  in  the  institution) . 
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FSUPPY(i)  =  total  cost  of  supplies  consumed  in  year  i  in  institutional  field 
training 

=  [FPETRO(i)  +  FAMMO(i)  +  FCONSU(i)]  •  SI(i) 

EXAMPLE: 

The  battery  tells  you  that  it  costs  $140  per  day  for  POL  to 
get  to  and  from  the  range  and  operate  for  the  day  on  the  range. 

FPETRO(i)  •  SI; i)  =  5  •  140  •  12  •  .25  =  $2100  =  $2.1  (thousands) 

TRADOC  Form  dIO-R  (TRADOC  Reg  11-5)  lists  ammunition  costs 
for  the  course  and  for  the  year  at  $100,000.  Thus, 

FAMMO(i)  •  SI(i)  =  100,000  •  .25  =  25,000  =  $25.0  (thousands) 

The  battery  tells  you  that  they  use  a  personnel  cost  factor 
of  $1.00  per  man  per  day  in  the  field  for  consumable  supplies. 

There  are  90  men  in  the  battery. 

FCONSU(i)  •  SI(i)  =  (90  •  5  •  12  •  $1.00  •  .25)  +  (200  •  5 
•  $1.00  •  .25)  =  1350  +  250  =  1600  =  $1.6  (thousands) 

FSUPPY(i)  =  $2100  +  25,000  +  1600  =  28700  =  $28.7  (thousands) 


FCINST(i)  =  total  cost  of  pay  and  allowances  in  year  i  of  instructors  of 


institutional  field  training 
=  FPALIN(i)  •  FINSTR  •  FTIME  •  MESL(i) 


EXAMPLE: 

The  same  instructors  that  train  in  base  training  will  train 
in  the  field  (with  the  assistance  of  the  school  troop  battery). 

The  average  pay  and  allowances  of  these  instructors  was  determined 
previously  to  be  $19,440.  The  same  instructor/student  ratio  of  .1 
holds.  Time  in  the  field  has  been  determined  to  be  12  =  .25  =  FTIME 

W 

PC  INST ( i )  =  19,400  •  .1  •  .25  •  20  •  .25  =  $243  =  $.2  (thousands) 
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FPALSTU.)  =  total  cost  of  pay  and  allowances  in  year  i  of  students  in 


institutional  field  training 
=  ASTUPA  •  FTIME  •  SI 


EXAMPLE: 

Average  student  pay  and  allowances  wa s  determined  as  $10,128. 

FPALST(i)  =  10,128  •  200  »  .25  =  10550  =  $10.6  (thousands) 
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FPATRS(i)  =  total  cost  of  pay  and  allowances  of  troop  support  (P8  or  P2) 
year  i  for  institutional  field  training. 

=  APATRS(i)  •  FTIME 

EXAMPLE: 

From  TRADOC  Form  858-R  (column  g)  you  find  the  annual  MPA 
costs  of  the  battery  are  $850,000 

FPATRS(i)  =  850,000  •  12  •  .25  =  $53,125  =  $53-1  (thousands) 

TO 


j 

! 

FTRANS(i)  =  total  cost  of  transportation  of  equipment  and  anmunition  for 
institutional  field  training  in  year  i 


EXAMPLE: 

The  DIO  informs  you  that  the  anmunition  for  the  course  would 
have  a  shipping  weight  of  5  tons.  In  Section  III  of  TRADOC  Resource 
Factor  Handbook  you  find  a  factor  of  .0691.  The  DIO  also  tells  you 
that  the  distance  the  anmunition  is  shipped  is  750  miles. 

FTRANSCi)  =  5  •  .0691  •  750  •  .25  =  $64.76  =  $0.1  (thousands) 

which  can  be  disregarded  as  insignificant. 


FRVAST(i)  =  remaining  value  of  equipment  and  instructional  materials  used 


in  institutional  field  training  at  end  of  planning  period 


^  [FEAQCI(i) ]  •  Cl-(EAD) (N-i+1 ) ] 
i=1 


EXAMPLE: 

You  have  determined  FEAQCI(i)  to  be  $3.2  (thousands)  and  EAD 
to  be  .10. 


zuj 


UVALUE 


"  UDACST(i) 

-  2  - 

Si  (Ud)'1-" 


URVAST 


( 1+d)[ 


where 


UDACST(i)  =  total  non-discounted  cost  of  unit  training  in  year  i, 

UHVAST  =  remaining  value  of  facilities  and  equipment  used  in 
in  unit  training  at  end  of  planning  period  (N  years) . 

UDACST(i)  =  UFACOS(i)  +  UFMCOS(i)  +  UEAQCI(i)  +  UEM2CI(i) 

+  USUPPY(i)  +  UCTNR(i)  +  UCTNE(i)  +  UTRANS(i)  (6 

where 

UFACOS(i)  =  total  cost  of  unit  training  facilities  acquisition  in 
year  i.  See  conments  for  BFACOS(i).  With  respect  to 
unit  training  facilities,  an  example  would  be  the 
Moving  Target  Simulator  (MTS)  facilities  operated  by 
USA  Garrisons  at  various  locations  to  train  REDEYE 
tracking.  ’’Basis  of  issue"  and  estimated  cost  data 
should  be  available  from  Department  of  Training  De¬ 
velopment  (DTD)  and/or  the  Department  of  Combat  De¬ 
velopments  (DCD).  Another  possible  source  is  the 
office  of  the  Program/Project/Product  Manager  (PM) . 

UFMCOS(i)  =  total  cost  of  unit  maintenance  of  training  facilities 
in  year  i. 

UEAQCI(i)  =  total  cost  of  unit  training  equipment  acquisition  in 
year  i. 

UEM3CI(i)  =  total  cost  of  unit  training  equipment  maintenance  in 
year  i. 

USUPPY(i)  =  total  cost  of  supplies  consumed  in  unit  training  in 
year  i. 

UCTNR(i)  =  total  cost  of  pay  and  allowances  of  all  trainers  in  unit 
training  in  year  i. 

UCTNE(i)  =  total  cost  of  pay  and  allowances  of  trainees  in  unit 
training  in  year  i,  and 

UTRANS(i)  =  total  cost  of  travel  (including  per  diem)  and  equip¬ 
ment  transportation  in  connection  with  unit  training 
in  year  i. 

The  variables  in  Equation  6.1  are  further  defined  as  follows: 

UFMCOS(i)  =  UTSQFT(i)  •  UCSQFT(i)  (6 
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UFACOS(i)  =  total  cost  of  unit  training  facilities  acquisition  in  year  i 


J 


EXAMPLE: 

Let  us  assume  for  illustrative  purposes  that  each  of  ten  units 
requires  a  special  range  to  train  the  system.  Let  us  assume  further 
that  the  task  is  not  trained  to  proficiency  in  the  institution. 

(If  the  task  is  trained  to' proficiency  in  the  institution,  by  our 
definitions,  UVALUE  =0).  Task  training  continues  to  represent  25 
percent  of  total  system  training.  It  is  estimated  that  each  such 
P2  unit  will  have  to  train  an  average  of  16  trainees  per  year  on 
the  system.  Assume  further  that  the  acquisition  cost  of  each  range 
is  $10,000  (which  can  be  obtained  from  the  DIO). 

An  average  of  estimates  from  the  units  indicates  that  it  will 
take  two  weeks  on  the  range  to  bring  each  school  graduate  to  pro¬ 
ficiency  (but  two  such  students  can  use  the  range  concurrently). 

At  other  times  the  range  will  be  used  for  refresher  training  (not 
to  be  costed)  during  a  50  week  training  year. 

UFACOS(i)  r  10,000  «  .25  •  J6_  •  10  =  $8,000  =  $8  (thousands) 

50 


UFMCOS(i)  =  total  cost  of  unit  maintenance  of  training  facilities  in 
year  i 

=  UTSQFT(i)  •  UCSQFT(i) 

EXAMPLE: 

The  Director  of  Facilities  Engineering  informs  you  that  an 
average  cost  of  maintaining  the  special  ranges  would  be  $500  per 
year. 

UFMCOS(i)  =  500  •  10  *  .25  •  Jl6  =  $400  =  $.4  (thousands) 

50 


UTSQFT(i)  =  total  square  feet  of  unit  training  facilities  required 
in  year  i  to  train  the  particular  task  or  system. 

Refer  to  MTS  example  above  or  special  ranges  required 
for  this  task  or  system.  See  conments  for  UFACOS(i). 

UCSQFT(i)  =  cost  per  square  foot  of  operation  and  maintenance  of 
unit  training  facilities  in  year  i.  See  source  data 
conment  for  BCSQFT(i).  The  PM  or  TRADOC  System  Manager 
(TSM)  are  also  potential  data  sources. 

UTSQFT(i)  =  [USQFTE  +  UTNRE  •  USQFTR]  •  METL(i)  +  USQFTA  ( 


USQFTE  =  square  feet  per  trainee  of  unit  training  facilities 
(assumed  constant) .  See  source  data  conments  for 
UFACOS(i) . 

UTNRE  =  trainer  to  trainee  ratio  in  unit  training  (assumed 
constant ) . 

USQFTR  =  square  feet  of  unit  training  facilities  per  trainer 
(assumed  constant).  See  source  data  conments  for 
UFACQS(i) . 

METL  =  maximum  expected  trainee  load. 

USQFTA  =  square  feet  of  administrative  facility  space  required 

to  support  unit  training  on  the  particular  system  being 
studied.  If  the  space  would  be  required  even  if  the 
system  were  not  being  trained,  this  variable  will  be  zero. 
See  source  data  comments  for  UFACQS(i). 

UEAQCI(i)  = 


UEQIMP(i)  = 


UEQCIS(i)  = 


TU(i)  = 
UEM3CI(i)  = 


UEQIMP(i)  •  TU(i)  +  UEQCIS(i)  ( 


cost  per  trainee  of  variable-cost  equipment  used  in 
unit  training  in  year  i.  Potential  data  sources  are 
DTD,  DCD,  appropriate  PM,  TSM,  or  PM  TRADE.  For 
fielded  equipment,  costs  can  be  computed  from  SB-700-20 

cost  of  fixed-cost  equipment  acquired  for  unit 
training  in  year  i.  See  conments  for  UEQIMP  above. 

nunber  of  trainees  in  unit  training  in  year  i. 

UCOPMT(i)  •  TU(i)  +  UOMFEQ(i)  ( 
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UEAQCI(i)  =  total  cost  of  unit  training  equipment  acquisition  in  year  i 


=  UEQIMP(i)  •  TU(i)  +  UEQCIS(i) 


EXAMPLE: 

Since  no  equipment  is  required  solely  for  training  to  initial 
proficiency,  UEAQCI(i)  =  0  in  this  case.  Although  the  unit  may  be 
armed  with  the  system,  the  cost  of  the  system  is  properly  charge¬ 
able  to  the  operational  requirements  of  the  unit.  The  cost  of  the 
equipment  would  be  the  same  even  if  there  were  no  training. 

Because  UEAQCI(i)  =  0,  UEM3CI  also  is  zero. 
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UCOPMT(i)  =  cost  per  trainee  of  maintenance  of  variable-cost  unit 
training  equipment  in  year  i.  Potential  data  sources 
are  PM,  TSM,  PM  TRADE,  TA50. 

UOMFEQ(i)  =  cost  of  operation  and  maintenance  of  fixed-cost  unit 
training  equipment  in  year  i.  See  comnents  for 
UCOPMT(i)  above. 

USUPPY(i)  =  [UPETRO(i)  +  UAMMO(i)  +  UCONSU(i)]  •  TU(i)  (6.14) 

where 

UPETRO(i)  =  cost  per  trainee  of  petroleum  products  (POL)  consumed 
in  year  i.  Each  major  unit  has  developed  consumption 
factors  for  unit-miles  per  gallon  and  vehicle-miles 
per  gallon  for  both  MOGAS  and  diesel  as  well  as  con¬ 
sumption  per  day  for  generators,  stoves,  etc.  Data 
are  also  available  for  "unit  day  in  the  field”  that 
combines  these  consumption  figures.  The  FORSCOM 
training  management  control  system  (TMCS)  and  USAREUR 
control  of  logistic  expenditure  (COLEX)  present  such 
operating  cost  factors.  Latest  cost  per  gallon  for 
MOGAS  and  diesel  can  be  obtained  from  the  Defense  Fuel 
Supply  Center. 

UAMMO  =  cost  per  trainee  of  ammunition  expended  in  unit  training 
in  year  i.  TC  25-3,  Training  Ammunition,  may  be  used 
as  a  guide.  Costs  can  be  computed  from  SB-700-20  and 
TAMIS  for  standard  ammunition.  For  developing  systems, 
check  PM,  TSM. 

UCONSU(i)  =  cost  per  trainee  of  miscellaneous  consumables  consumed 
in  unit  training  in  year  i.  Use  "unit  day  in  the  field" 
factor  by  type  unit.  Major  cost  item  generally  is 
spare  parts  and  this  will  be  included  in  the  factor. 

UCTNR(i)  =  UPATNR(i)  «  UTNRE  .  UTIME  •  TU(i)  (6.15) 

where 

UPATNR(i)  =  average  annual  pay  and  allowances  of  a  trainer  in  unit 
training  in  year  i.  Compute  in  accordance  with  Section 
III,  TRADOC  Resource  Factor  Handbook. 

UTIME  =  fraction  of  year  spent  by  each  trainee  in  unit  training. 

UCTNE  =  UP ATNE(i)  «  UTIME  *  TU(i)  (6.16) 

where 

UPATNE(i)  =  average  annual  pay  and  allowances  of  trainees  in  unit 
training  in  year  i.  Compute  in  accordance  with  Section 
III,  TRADOC  Resource  Factor  Handbook. 
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USUPPY(i)  =  total  cost  of  supplies  consumed  in  unit  training  in  year  i 


=  [UPETRO(i)  +  UAMMO(i)  +  UCONSU(i)]  •  TU(i) 


EXAMPLE: 

"Unit  day  in  the  field"  data  from  several  batteries  average 
$150  per  day  for  a  battery  to  go  to  and  from  the  ranges  ana  to 
operate  per  day  in  the  field.  There  are  90  men  total  in  each  of 
ten  such  batteries. 

UPETRO(i)  •  TU(i)  =  150  •  10  •  5  •  2  •  .25  •  J6  s  $667  = 

90 

$.7  (thousands) 

Queries  to  the  G-3  (Training)  of  the  different  divisions  in¬ 
volved  indicate  an  average  of  five  rounds  per  trainee  for  profi¬ 
ciency  training  on  the  system  and  a  cost  of  $50  per  round. 

UAMMO(i)  •  TU(i)  =  $50  •  5  •  .25  •  16  •  10  =  $10,000  = 

$10  (thousands) 

"Unit  day  in  the  field"  data  from  several  batteries  average 
$1.30  per  man  per  day  in  the  field  for  consumable  supplies  (in¬ 
cludes  spare  parts) . 

UCONSU(i)  •  TU(i)  =  $1 .30  •  10  •  5  •  2  •  .25  •  16  =  $520  = 

$.5  (thousands) 

USUPPY  =  $667  +  10,000  +  52C  =  $11,187  =  $11.2  (thousands) 
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UCTNR  =  total  cost  of  pay  and  allowances  of  all  trainers  in  unit  training  in 


1 


year  i 

=  UPATNR(i)  •  UTNRE  •  UTIME  •  TU(i) 


EXAMPLE: 

You  determine  from  the  procedures  in  Section  III,  TRADOC 
Resource  Factor  Handbook  that  the  average  pay  and  allowances 

1 

j  (UPATNR(i))  of  a  trainer  for  the  system  =  $14,000.  The  ratio  of 
trainers  to  trainees  for  initial  proficiency  training  =  1:2  =  UTNRE. 
Each  trainee  will  spend  two  weeks  of  the  50  week  training  year  in 
completing  his  initial  proficiency  training  (UTIME)  =  2  ~  50.  There 
will  be  16  such  trainees.  The  task  training  will  take  25  percent  of 
the  system  training  time.  Thus, 

UCTNR  =  $14,000  «  j_  •  _2  •  16  •  10  •  .25  =  $11,200  = 

2  50 

$11.2  (thousands) 


UCTNE(i)  =  total  cost  of  pay  ana  allowances  of  trainees  in  unit  training  in 


year  i 

=  UPATNE(i)  •  UTIME  •  TU(i) 


EXAMPLE: 

Using  the  procedures  in  Section  III,  TRADOC  Resource  Factor 
Handbook,  you  determine  the  average  pay  and  allowances  of  a  trainee 
(UPATNE(i))  =  $10,128.  You  have  already  determined: 

UTIME  =  _2 , 

50 

TU(i)  =  1b, 

UCTNE(i)  =  $10,128  •  _2  •  16  •  10  •  .25  =  $16200  = 

50 

$16.2  (thousands) 


UTRANSi.i)  =  UTRAVL(i)  •  TU(i)  +  UEQTRS(i) 


(6.17) 


where 


UTRAVL(i)  =  cost  per  trainee  for  travel  (including  per  diem)  in 
connection  with  unit  training  in  year  i.  Compute  in 
accordance  with  Section  III,  TRADOC  Resources  Factor 
Handbook . 


UEQTRS(i)  =  cost  for  transportation  of  equipment  used  in  unit 
training  in  year  i.  Compute  in  accordance  with 
Section  III,  TRADOC  Resource  Factor  Handbook. 


N 

URVAST  = 

i=1 


[UFACOS(i) ]  •  [l-(FAD)(N-i+1 ) ]  + 
[UEAQCI(i)]  •  [l-(EAD)(N-i+1)] 


(6.2) 


Having  determined  the  total  cost  to  train  each  individual  task  to  initial 
proficiency,  the  cost  of  the  total  training  program  may  be  determined  as  follows: 


M 

TPROGR  = 

j=1 


TVALUEj 


(7) 


where  M  =  number  of  tasks  contained  in  the  program. 

As  a  convenience  to  the  reader,  all  of  the  foregoing  equations  are  pre¬ 
sented  sequentially  without  text  in  Appendix  2  to  Annex  D. 

As  a  further  convenience,  a  matrix  of  variables  versus  potential  data 
sources  is  at  Appendix  3  to  Annex  D. 
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(JTRANS(i)  =  total  cost  of  travel  (including  per  diem)  and  equipment  transporta¬ 
tion  in  connection  with  unit  training  in  year  i 

=  [UTRAVL(i) ]  •  TU(i)  •  UEQTRS(i) 

EXAMPLE: 

Since  there  is  no  trainee  travel  involved  in  this  case, 

UTRAVL(i)  =  0.  DIO  informs  you  that  ammunition  to  be  used  for  ini¬ 
tial  proficiency  training  has  a  shipping  weight  of  one  ton  and  the 
shipping  distance  averages  500  miles  for  all  ten  units.  The  factor 
from  Section  III,  TRADOC  Resource  Factor  Handbook  =  .0691. 

UEQTRS(i)  =  1  •  .0691  •  500  •  10  •  .25 

=  86.36 

=0.1  (thousands) 

which  can  be  disregarded  as  insignificant. 


URVAST  =  remaining  value  of  facilities  and  equipment  used  in  unit  training  at 


end  of  planning  period  (N  year) 


N 

=  V  [UFACOS(i) ]  •  [ 1-(FAD)(N-i+1 ) ]  +  [UEAQCI(i)  *  [ l-(EAD) (N-i+1 ) ] 
i*l 


EXAMPLE: 

You  have  determined  that: 

UFACOS(i)  =  $12,000 
UEAQCI(i)  =  0 


FAD 


.10 


E.  Comparison  of  Training  Program  Alternatives 


1 .  TEEM 

Having  determined  the  effectiveness  of  two  or  more  alternatives  by 
computing  their  efficiency  ratios  (see  paragraph  Cl  above),  compare  the  alterna¬ 
tives  on  the  basis  of  these  efficiency  ratios  and  the  cost  of  the  alternatives. 

In  order  to  help  you  avoid  dealing  with  very  large  numbers  when  you  form  cost/ 
effectiveness  ratios,  you  may  want  to  normalize  the  costs  of  the  alternatives. 
(This  can  be  done  simply  by  dividing  the  cost  of  each  alternative  by  the  cost 
of  the  lowest  cost  alternative.  Note  that  the  normalized  cost  of  the  lowest 
cost  alternative  becomes  1 .  The  relationship  among  the  costs  remains  the  same, 
but  the  ratios  are  more  manageable.) 

2.  TCA 

The  basis  for  this  process  method  has  been  established  by  the  procedures 
given  in  paragraph  C5  (TCA).  The  output  information  derived  from  those  proce¬ 
dures  are  needed  for  this  procedure. 

Step  1 .  Assemble  the  TCA  output  information  derived  from  Process 
Method  C  as  shown  in  the  example  in  Table  III-16.  Arrange  task  information  by 
task  group  and  also  include,  if  applicable,  group  statistics. 

Step  2.  Compare  alternative  training  programs  by  TCRs  of  tasks,  of 
task  groups,  and  of  all  tasks  (the  overall  TCR) .  Tentatively  select  the  alter¬ 
native  with  the  highest  overall  TCR. 

Step  3 •  Compare  alternatives  task  by  task.  Compare  alternative  defi¬ 
ciencies,  excesses,  and  redundancies,  and  if  one  alternative  is  an  actual  program 
while  others  are  only  descriptions,  decide  if  revision  of  the  actual  program  can 
be  reconmended  on  this  basis. 

Step  M .  Eliminate  from  consideration  training  program  alternatives 
with  unacceptable  TCRs. 

Step  5.  With  cost  estimates  from  Process  Method  III-D,  form  a  C/E 
ratio  for  each  remaining  alternative  (cost/TCR).  Choose  the  alternative  with 
the  lowest  or  lower  C/E  value. 

3.  EDM/CARAF* 

This  method  of  comparison  of  training  program  alternatives  assumes 
that  you  have  comparable  effectiveness  data  for  the  alternatives  you  are  com¬ 
paring  and  that  you  have  cost  data  from  which  you  can  derive  the  life  cycle  cost 
per  unit . 


a.  Complete  the  training  system  data  matrix  by  first  assigning  a 
weight  to  each  of  the  measures  of  training  effectiveness  (MOTEs)  selected. 
Assign  weights  between  "1"  and  "99”,  and  they  should  indicate  your  judgment  as 


•Adapted  from  BDM  Services  Company,  Cost  and  Training  Effectiveness  Analysis 
(CTEA)  Handbook  for  Action  Offices,  15  January  19767 


Table  ITI-16.  TCA  Output  Data 

(adapted  from  Hawley  and  Thomason,  1978) 


650 


1 


to  the  relative  worth  of  the  MOTEs.  Usually  weights  between  50  and  90  will 
be  most  satisfactory.  If  a  MOTE  has  little  impact  upon  the  overall  effective¬ 
ness  of  the  system,  reconsider  the  need  for  the  MOTE.  Further,  if  a  MOTE  has 
a  weight  of  100,  you  would  not  need  to  have  other  MOTEs.  Use  you  best  judgment. 
For  example: 


MOTE, 

MOTE  2 

mote3 

MOTE^ 

EE 

we:c;;tc‘> 

90 

50 

BASE  CASE 

A1 

*2  1 

A3 

b.  Determine  the  MOTE  data  values  for  the  base  case  and  each  of  the 
alternative  systems  as  shown  below.  Document  the  sources  of  data.  If  no  data 
are  available,  document  this  fact  also. 


MOTE, 

M0TE2 

M0TE3 

MOTE^ 

EE 

WEIGHTS* 

90 

50 

BASE  CASE 

85 

90 

A. 

89 

30 

A2 

c.  Add  MOTE,  values.  Subsequently  add  M0TE£  values,  etc. 


Examples : 


90 

_30 

120 


d.  Divide  each  MOTE  value  by  the  sum  of  the  MOTE  values  from  previous 
step  shown  in  the  examples.  This  produces  a  relative  effectiveness  score  within 
each  MOTE. 


.49 

174755750 


.75 

1207900 
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MOTE  j 

M0TE2 

K0TE 

mote4 

EE 

WEIGHTS* 

90 

50 

. 

X 

BASE  CASE 

•  49 

.75 

A1  ^ 

•  51 

.25 

A2 

— - - 

A3 

— - 

e.  When  previous  steps  have  been  completed  for  all  training  systems 
and  all  MOTEs,  multiply  the  decimal  value  (relative  effectiveness  score)  pro¬ 
duced  in  Step  d  times  the  weight  assigned  to  the  particular  MOTE  and  insert  the 
product  (weighted  relative  effectiveness  score)  into  the  appropriate  spaces  on 
the  matrix. 


MOTE, 

MOTE^ 

MOTEj 

M0TE4 

EE 

WE  1 GHTS-+ 

90 

50 

BASE  CASE 

44.1 

37.5 

A, 

45.9 

12.5 

A2 

A3 

f.  Add  the  values  for  the  base  case  and  for  each  training  alternative 
across  the  horizontal.  Insert  the  sums  (total  weighted  effectiveness  score) 
in  the  appropriate  "£"  spaces  in  the  training  system  matrix. 

Examples:  44.1  45.9 

37.5  12.5 
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M0TE1 

mote2 

M0TE3 

mote4 

EE 

WE  1 GHTS > 

90 

50 

BASE  CASE 

M*.l 

37-5 

81  .6 

A1 

**5.9 

12.5 

58.  A 

A2 

' 

*3 

g.  List  the  total  life  cycle  costs  for  each  training  program  alterna¬ 
tive  as  shown  in  the  example  below. 

h.  Determine  the  total  number  of  hours  (or  other  appropriate  unit  of 
use)  of  useful  life  of  the  systems  and  list  as  shown  below. 

i.  Divide  results  of  Step  g  by  the  results  of  step  h  as  shown  in  the 
example  below.  Insert  the  quotients  as  shown. 


TOTAL  LIFE  CYCLE  COSTS 

TOTAL  LIFE  CYCLE  UTILIZATION 
UNITS 

LIFE  CYCLE  COST  PER  UNIT 


j.  The  comparison  of  training  program  alternatives  is  a  cost  benefit 
analysis  with  formulae  as  shown  below.  These  formulae  show  the  comparison  among 
a  base  case  (BC)  and  three  alternatives  (A, ,  A2,  A,).  The  left  column 
shows  the  combinations  of  comparisons  of  two  alternatives  at  a  time.  With  fewer 
alternatives  there  will  be  fewer  combinations  of  two.  Each  pair  comparison  has 
a  corresponding  formula  in  the  right  column.  These  equations  establish  effi¬ 
ciency  ratios  (e.g.,  Eg)  which  when  multiplied  by  the  "cost  per  unit"  (step  i 

^1) 

above)  give  a  product  to  be  compared  with  the  "cost  per  unit  of  the  other  al¬ 
ternative  of  the  pair. 
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COST  BENEFIT  ANALYSIS 


BC-Aj 


CB±CA 


3C-A2 


CB  i  CA. 


BC*A,  Cn  <  C 


B  “  Ea 

3  A, 


Al‘A2  CA  -  CA  T~ 
A1  A2  EA„ 


ArA3  ca  -  CA  -r1 

5  A1  A3  EA, 


V#3  %  i 

2  3  A, 


k.  Start  by  selecting  two  alternatives  for  comparison.  For  the  fol¬ 
lowing  example,  the  base  case  is  compared  with  alternative  one. 


BC 


1.  Find  the  appropriate  formula  from  paragraph  j  above,  right  column. 


Example: 


°B  <  C 


A1 


"B 

SA1 


m.  Divide  the  measure  of  efficiency  for  the  base  case  (Eg)  by  the 
measure  of  efficiency  (EA  )  of  the  alternative. 


"B 


81.6 

58.4 


1.4 


n.  Multiply  the  value  obtained  in  Step  m  by  the  cost  per  unit  use 
for  the  first  alternative  training  system  (Cft  )  (from  Step  9). 


11,111.11)  x  (1 .4)  =  15,555.55 
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o.  Compare  the  value  obtained  from  Step  n  with  the  "cost  per  hour 
use”  for  the  base  case  (Cg) .  The  mathematical  symbol  ”<"  means  "equal  to  or 
less  than”.  If  Cg  is  "equal  to”  the  value  obtained  in  Step  n,  the  two  systems 
are  equal  on  a  cost  benefit  comparison .  If  Cg  is  "less  than"  the  value  obtained 
in  Step  n,  the  base  case  is  better  than  the  first  alternative.  If  Cg  is 
"greater  than"  the  value  obtained  in  Step  n,  the  alternative  is  better  than 

the  base  case. 

p.  Make  cost  benefit  comparisons  between  each  of  the  remaining  sys¬ 
tems  (if  any) . 

q.  Select  the  optimal  system. 

4.  DIVAD  Gun 

Given  alternatives  rank-ordered  on  the  basis  of  estimated  effective¬ 
ness  and  cost  estimates  for  the  alternatives,  establish  a  cost  effectiveness 
matrix  similar  to  the  following. 


Alternatives 

Effectiveness 

Cost 

Overall 

Ranking 

1 

3 

3 

3 

2 

2 

2 

2 

3 

1 

1 

1 

In  the  DIVAD  Gun  CTEA,  for  example,  the  estimated  cost  of  Alternative  1 
was  roughly  three  times  the  cost  of  Alternative  3  (which  was  estimated  to  be  the 
most  effective  alternative) .  Alternative  3  was  easily  identified  as  the  best 
choice. 


Your  situation  may  not  fall  into  place  as  nicely  as  this  DIVAD  Gun 
case,  but  again  your  expertise  and  judgment  will  have  to  suffice  if  you  have  no 
other  data. 

•  5.  DRIMS  CTEA  (USAIS,  Diagnostic  Rifle  Marksmanship  Simulators,  Cost  and 

Training  Effectiveness  Analysis,  August  197b)* 

This  method  has  been  used  by  the  Infantry  School  and  is  particularly 
appropriate  in  comparing  alternative  simulators  of  an  operational  weapon  system 
(base  case)  as  a  result  of  testing. 

a.  List  the  critical  skills  that  must  be  taught  by  the  alternative 
systems  you  are  comparing.  Provide  columns  for  each  alternative. 


•Adapted  from  the  cited  study. 
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b.  For  each  alternative  check  the  cell  for  each  critical  skill  the 
alternative  can  teach,  as  in  the  example  below.  Obviously,  the  operational 
system  will  meet  all  the  critical  skill  requirements. 


Teach  Critical  Skill 

Alt  1 

Alt  2 

Alt  3 

Skill  1 

X 

X 

2 

X 

X 

X 

3 

X 

X 

4 

X 

X 

5 

X 

X 

X 

n 

c.  For  each  alternative  compute  the  percentage  of  the  total  number  of 
critical  skills  that  the  alternative  has  the  capability  of  teaching. 

d.  Rank  order  the  alternatives  for  the  factor,  Relative  Capability  of 
Teaching  the  Critical  Skills  from  highest  to  lowest  (1  to  n) . 

e.  Determine  from  your  test  data  what  you  will  use  as  your  measure  of 
training  effectiveness.  In  the  DRIMS  CTEA,  for  example,  the  relative  training 
effectiveness  (RTE)  factor  was  based  on  overall  probability  of  hit  (P„) , 

since  it  provided  the  most  stable  index  of  rifle  firing  proficiency.  nRTE  in 
this  case  is  defined  as: 

Overall  PH  of  the  alternative  training  device 
RTE  =  _ _ _ 

Overall  PH  of  the  baseline  M16/M193 

RTE  is  an  index  of  the  relative  effectiveness  of  each  alternative  training  de¬ 
vice  with  respect  to  the  baseline  weapon  or  system.  If  RTE  is  1.0,  an  alterna¬ 
tive  is  equal  to  the  baseline  in  terms  of  training  effectiveness.  If  it  is  less 
than  1.0,  it  is  less  effective  than  the  baseline.  Rank  order  the  alternatives 
based  on  the  RTE  from  highest  to  lowest  (1  to  n) . 

f.  Determine  the  cost  of  each  alternative  relative  to  the  base  case. 

RC  =  Cost  of  alternative 
Cost  of  base  case 

Rank  order  the  alternatives  based  on  the  RC  of  each  from  lowest  to  highest 
(1  to  n). 

g.  Determine  relative  user  acceptance  (RUA).  "User  acceptance  is  an 
important  factor  in  any  decision  to  choose  a  training  device.  Far  too  often 


devices  remain  in  the  training  room  and  are  never  utilized  due  to  lack  of 
user  acceptance  and  perceived  value.  These  attitudes  often  cannot  be  finitely 
evaluated  but  they  must  be  appraised."*  From  test  or  survey  data: 

RUA1  =  nunber  of  trainers  preferring  Alternative  1 
number  of  trainers  preferring  base  case 

Rank  order  the  alternatives  based  on  the  RUA  of  each  from  highest  to  lowest 
(1  to  n) . 


h.  Add  the  rankings  for  the  four  factors  of  each  alternative.  Deter¬ 
mine  the  overall  rank  order  of  the  alternatives  with  the  most  preferable  alter¬ 
native  having  the  lowest  sum. 

i.  Figure  III-30  is  an  example  of  the  ranking  factors  and  ranking  of 
training  alternatives  from  the  cited  study. 

6.  Analogous  Task  Method 

Having  determined  the  effectiveness  of  two  or  more  analogous  tasks 
( see  paragraph  C3  above) ,  compare  the  training  programs  of  each  on  the  basis 
of  the  proven  effectiveness  of  each  and  the  cost  of  each. 

7 .  TECEP 

Having  developed  alternative  training  programs  by  the  procedures  in 
Section  IIIB2  above,  compare  the  programs  on  the  basis  of  relative  cost  and 
your  judgment  of  their  merits  as  you  work  them  through  the  practicality  test 
in  that  section. 


•DRIMS  CTEA,  p.  46. 
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BASELINE  ALTERNATIVES 


RANKING  FACTORS 

Ml  6 

WPNEER 

LTRN 

RFA 

RELATIVE  TRAINING  EFFECTIVENESS  (RTE) 

Record  Fire  PH 

1.0 

1.01 

0.99 

o 

o 

Relative  Training  Effectiveness  Rank 

(1) 

(1) 

(1) 

0) 

RELATIVE  COST  (RC) 

a.  Table  4,  Section  V 

1.0 

0.08 

C.05 

0.10 

b.  Relative  Cost  Rank 

(4) 

(2) 

(1) 

(3) 

RELATIVE  CAPABILITY  (RCP) 

a.  Table  IV-I 

1.0 

0.86 

0.50 

0.64 

b.  Relative  Capability  Rank 

(1) 

(2) 

(4) 

(3) 

RELATIVE  USER  ACCEPTANCE  (RUA) 

a.  CET  of  Weaponeer  &  Lasertrain 
dated  Oct  77 

1.0 

4.33 

1.0 

0.33 

b.  Relative  User  Acceptance  Rank 

(2) 

(1) 

(2) 

(3) 

TOTAL  OF  RANKINGS 
COST  AND  TRAINING 

(LOWEST  SCORE  MOST 
EFFECTIVE) 

(8) 

(6) 

(8) 

(10) 

FINAL  ALTERNATIVE 

RANKINGS 

(2) 

0) 

(2) 

(3) 

Figure  III-30 .  Ranking  Factors  and  Ranking  of  Training  Alternatives 
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F. 


Resolution  of  Issues 


1.  I TV  CTEA  (TRADOC,  Cost  and  Operational  Effectiveness  Analysis  for 
the  Improved  TOW  Vehicle  (ITV ) ,  Part  IV,  Cost  and  Training  Effective¬ 
ness  Analysis,  June  1978). 

All  the  issues  you  will  have  to  resolve  in  your  CTEA  cannot  be  pre¬ 
dicted.  For  example,  one  of  the  objectives  of  the  above  cited  CTEA  was  to 
determine  if  it  were  more  cost  effective  to  train  the  system  at  Fort  Benning 
or  at  Fort  Knox.  The  alternatives  considered  were: 

o  Alternative  #1  -  Train  TOWCAP  at  Fort  Knox  and  Fort  Benning. 

o  Alternative  #2  -  Train  ITV  and  ground  mount  at  Fort  Benning. 

o  Alternative  # 3  -  Train  ITV  and  ground  mount  at  Fort  Knox. 

o  Alternative  #4  -  Train  ITV  at  Fort  Benning  and  TOW  ground  mount 

at  Fort  Knox. 

o  Alternative  #5  -  Train  TOW  ground  mount  at  Fort  Benning  and  ITV 
at  Fort  Knox. 

For  the  effectiveness  portion  it  was  assumed  that  training  at  Fort 
Benning  and  training  at  Fort  Knox  were  equally  effective.  (You  must  be  very 
careful  in  making  such  assumptions  and  in  all  your  assumptions.)  The  cost 
analysis  showed  that  Alternative  #3  was  the  most  cost  effective  (i.e.,  Fort 
Knox  was  determined  to  be  the  least  cost  training  location  for  the  ITV  and 
ground  mount) . 

Normally,  the  system  for  which  your  school  is  the  proponent  will  be 
trained  at  your  school  but  some,  of  course,  will  involve  two  or  more  schools 
as  with  the  TOW.  This  process  method  merely  illustrates  one  way  of  resolving 
the  training  location  issue  as  a  guide  and  reference. 

2.  DRIMS  CTEA  (USAIS,  Diagnostic  Rifle  Marksmanship  Simulators  Cost  and 
Training  Effectiveness  Analysis ,  August  197b). 

Given  issues  to  resolve  such  as  user  acceptance  and  capability  of 
alternatives  to  teach  reauired  skills,  you  may  be  able  to  resolve  them  as  in 
the  cited  method. 

Use  the  procedure  outlined  in  paragraph  E5  above  under  "Comparison  of 
Training  Alternatives"  to  determine  the  relative  ranking  of  alternatives  with 
respect  to  the  issues. 

3 .  Trainability  Analysis 

This  method  is  a  way  to  resolve  the  issue  of  trainability  of  tasks. 
First,  compare  task  descriptions  and  training  programs  with  available  data  on 
personnel  characteristics.  On  the  basis  of  this  informal  (subjective)  compari 
son,  rate  the  risk  that  a  task  cannot  be  adequately  trained  as  (1)  High,  (2) 
Moderate,  or  (3)  Low. 


Compare  the  tasks  with  mission  analyses  or  operational  concepts  and 
rate  the  criticality  of  each  task  to  the  mission  as  (1)  High,  (2)  Moderate,  or 
(3)  Low. 

Construct  a  matrix  such  as  in  Figure  III— 31  showing  risk  versus  criti¬ 
cality.  Where  high  risk-high  criticality  tasks  coincide,  great  concern  for 
trainability  is  indicated,  where  moderate  risk-moderate  criticality  tasks  coin¬ 
cide,  moderate  concern  is  indicated;  and  where  low  risk-low  criticality,  high 
risk-low  criticality,  or  low  risk-high  criticality  tasks  coincide  little  or  no 
concern  is  indicated. 


CRITICALITY 


RISK 


1  ■ 

(1) 

(2) 

(3) 

HIGH 

MODERATE 

LOW 

(1) 

HIGH 

H 

M 

L 

(2) 

MODERATE 

M 

M 

L 

(3) 

LOW 

L 

L 

L 

H  =  HIGH  CONCERN 
M  =  MODERATE  CONCERN 
L  =  LOW  CONCERN 


Figure  III-31.  Trainability  Concern  Matri 
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G .  Sample  Procedure 

In  order  to  help  you  tie  the  processes  together  into  a  CTEA,  the  following 
hypothetical  example  exercises  the  general  CTEA  model  that  has  been  discussed. 

Situation 

You  have  been  required  to  perform  a  CTEA  on  a  new  air  defense  system 
(System  X)  that  is  in  its  early  stages  of  development  to  counter  a  short  range 
air  defense  (SHORAD)  threat.  Concurrently,  procurement  of  a  simulator  for 
training  is  being  considered.  The  purpose  of  your  CTEA  is  to  allow  decision 
makers  to  assess  the  training  impacts  of  the  system,  both  as  to  the  estimated 
cost  and  the  estimated  effectiveness  of  training  on  the  system. 

Procedures 

1 .  Assessment  of  Data  and  Choice  of  Strategy 

Using  the  guidelines  of  Figure  II— 1 ,  General  CTEA  Model  (p.  II-2), 
assess  the  available  data.  You  find  you  have  no  training  program  and  no  task 
list  for  the  developing  system.  This  requires  Strategy  1  (p.  II-7),  and  you 
find  you  will  need  to  do  all  the  processes: 

a.  Generate  a  task  list, 

b.  Predict  training  programs, 

c.  Estimate  effectiveness, 

d.  Cost  the  training  programs, 

e.  Compare  the  training  program  alternatives, 

f.  Resolve  issues. 

2.  Generate  a  Task  List 

Table  II— 1  (p.  II— 7 )  lists  three  methods  for  generating  a  task  list. 
After  reading  Section  IIIA  (starting  on  p.  II— 1 ) ,  you  decide  the  DIVAP  Gun  ap¬ 
proach  most  nearly  matches  your  situation.  As  an  air  defense  subject  matter 
expert  (SME),  you  have  some  familiarity  with  System  X  and  considerable  knowledge 
concerning  air  defense.  You  know,  for  example,  that  the  system  is  a  missile 
system  that  will  employ  new  scanning,  acquisition,  and  tracking  subsystems  that 
are  not  radar.  There  will  be  an  optical  sighting  subsystem  as  backup.  The  mis¬ 
sile  will  have  an  improved  infrared  (IR)  lock-on  capability.  You  also  know  that 
although  there  will  be  an  identification  of  friend  or  foe  (IFF)  subsystem,  vis¬ 
ual  identification  will  be  needed  as  backup.  You  start  to  build  your  task  list: 

o  Perform  preventive  maintenance  checks  and  services  (PMCS)  on 
the  system. 

o  Perform  troubleshooting  procedures  on  the  system. 


o  Acquire  targets 

o  Track  targets 

o  Engage  targets 

o  Visually  identify  aircraft 

3.  Prediction  of  Alternative  Training  Programs 

The  next  step  is  the  development  of  alternative  programs  to  train  the 
tasks  on  the  list  you  have  drawn  up.*  Consulting  Table  II— 1 ,  Column  B,  you  find 
four  suggested  methods  for  predicting  training  programs:  TEEM,  TECEP,  DIVAD  Gun, 
and  ATM.  Since  you  have  generated  a  task  list  and  you  are  familiar  with  earlier 
systems  that  train  similar  tasks,  you  decide  to  use  ATM  to  predict  alternative 
training  programs. 

Three  tasks  —  acquire,  track  and  engage  targets  —  group  themselves 
into  a  set  that  will  be  trained  together.  The  action  verbs  are  on  the  ATM  task 
verb  list.  Ycu  have  found  two  similar  weapon  systems  that  require  that  opera¬ 
tors  be  trained  to  track  a  target  in  a  continuous,  regulatory  movement  and  have 
found  close  comparability  among  all  three  systems  on  the  initiating  cues,  cue 
characteristics,  responses  to  cues,  response  characteristics,  and  feedback  cate¬ 
gories  and  characteristics  (see  ATM  example,  III.B.4,  p.  III-21 ) . 

The  next  step  is  to  look  at  the  training  programs  of  these  two  prede¬ 
cessor  systems  —  System  A  and  System  B.  You  find  the  following: 

System  A  teaches  target-related  tasks  in  the  institution.  Crewmen  at 
Level  1  are  instructed  in  a  school-taught,  529-hour  course  without  self-pacing. 
One  instructor  is  assigned  10  students.  The  System  A  POI  schedules  twenty- five 
hours  of  instruction  in  these  skills.  Anmunition  is  allotted  at  the  rate  of 
. 1  System  A  guided  missile  per  student  to  be  used  during  the  five  hours  of  in¬ 
struction  that  takes  place  in  the  field.  The  student  is  expected  to  be  90% 

accurate  to  pass  this  part  of  his  course. 

System  B  trains  target  acquisition,  tracking,  and  engagement  in  a 
moving  target  simulator  in  a  controlled  environment.  Twenty  training  hours 
(two  in  conference  and  18  in  practical  experience)  are  allotted.  The  trainee 
is  expected  to  engage  successfully  80%  of  the  targets  presented.  This  training 
is  followed  by  five  hours  of  examination  tracking  live  targets.  Ammunition  re¬ 
quirements  for  this  task  are  .2  System  B  guided  missile  per  student. 

You  know  that  the  new  system  will  be  taught  in  the  same  type  school 
environment  and  be  subject  to  approximately  the  same  course  length  and  facili¬ 
ties.  You  know  that  a  simulator  is  being  considered.  Using  the  training  for 
Systems  A  and  B  as  models,  you  can  now  predict  alternative  programs  for  this 
set  of  tasks  for  System  X.  You  might  present  them  as  follows: 


•From  this  point  on  we  will  use  one  set  of  related  tasks  to  illustrate  the  CTEA 
model.  In  an  actual  CTEA  you  would,  of  course,  use  the  entire  task  list. 
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Alternative  1 


20  hours  of  classroom  instruction 

5  hours  of  instruction  in  the  field 

1  instructor 

10  students 

1  System  X  guided  missile  per  class 

A  set  of  visual  aids  for  identifying  targets 

Alternative  2 

2  hours  of  classroom  instruction 

Id  hours  of  practical  experience  in  a  moving  target  simulator 

5  hours  of  examination  tracking  live  targets  in  the  field 

1  instructor 

10  students 

2  System  X  guided  missiles  per  class 

4 .  Estimate  Effectiveness 

You  must  now  estimate  how  successful  each  of  these  programs  will  be  in 
training  soldiers  to  be  System  X  missile  crewmen.  Unless  the  CTEA  you  are  con¬ 
ducting  takes  place  after  some  field  testing  and/or  production  of  a  prototype 
simulator,  you  will  not  be  able  to  field  test  the  alternative  training  programs 
and  determine  their  relative  effectiveness.  Therefore,  you  can  choose  one  of 
the  methods  recommended  for  Process  C,  Estimation  of  Effectiveness  (TEEM,  DIVAD 
Gun,  ATM,  TRAINVICE,  or  TCA,  see  p.  III-35  to  III-77).  Since  you  were  success¬ 
ful  in  finding  the  target-related  tasks  taught  in  analogous  systems,  you  will 
probably  continue  to  use  ATM. 

In  the  process  of  predicting  the  training  programs  you  find  90%  accu¬ 
racy  was  required  for  System  A  trainees  and  80%  for  System  B.  You  study  the 
historical  data  at  the  school  and  find  that  70%  of  the  System  A  students  and 
85%  of  the  System  B  students  pass  their  examination  of  this  set  of  tasks  at 
the  end  of  training.  You  now  have  estimates  of  effectiveness  based  on  the 
effectiveness  of  the  analogous  programs  you  used  to  develop  your  proposed 
alternative. 

5.  Cost  the  Training  Program 

This  analysis  is  taking  place  early  in  the  life  cycle  of  System  X  and 
you  do  not  find  firm  cost  data  available.  You  consider  several  approaches. 

You  decide  that  the  reliability  of  the  data  indicate  that  the  per  student  costs 
of  training  for  Analogous  Systems  A  and  B  will  be  most  suitable.  You  note  that 
the  cost  of  development  of  the  proposed  training  device  will  be  so  large  as  to 
outweigh  any  differences  in  the  operating  costs  of  the  two  programs  so  you  omit 
this  from  your  calculations  leaving  its  assessments  for  the  required  separate 
device  C0EA.  You  foresee  no  unusual  training  +  connected  with  System  X. 
School  historical  data  show  that  it  costs  $8t.  .o  train  each  student  when 
trained  on  System  A  and  $1200,  on  System  B.  You  will  use  these  as  estimated 
costs  for  the  proposed  Alternatives  1  and  2. 
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b.  Compare  the  Training  Program  Alternatives 

You  now  have  estimates  of  the  effectiveness  of  two  programs  designed 
to  train  the  selected  task  and  of  the  institutional  cost  to  train  a  student 
to  perform  the  task.  The  costs  of  the  two  programs  and  are  on  the  same  basis 
since  you  are  excluding  the  necessarily  high  cost  of  developing  and  purchasing 
a  new  training  simulator.  You  have  chosen  normal  annual  operating  costs. 

Since  you  have  used  the  ATM  for  both  estimates,  this  low  level  of  precision 
indicates  that  you  continue  to  use  ATM  to  compare  the  training  programs.  You 
found  in  your  earlier  assessment  (Par.  4  and  5)  that: 


A 

B 

C 

Crewmen 

D 

E 

F 

Training 

Program 

Perfor¬ 

Overall 

Cost 

Cost/Ef f ecti ve- 

Program 

Effec¬ 

mance  Ef¬ 

Effective¬ 

(Class 

ness  Ratio 

Alternative 

tiveness 

fectiveness 

ness  (BXC) 

of  10) 

(Col.  E  f  Col.  1 

1 

.70 

.90 

•  b3 

$  a, 000 

12,698 

2 

•B5 

.ao 

.btt 

$12,000 

17 ,647 

The  first  program  produces  fewer  but  more  accurate  crevmen  at  the  lower  cost 
per  class.  The  second  produces  trained  students  more  effectively  but  they  are 
less  proficient  and  more  expensive.  On  calculating  the  C/E  you  find  a  lower 
value  for  Alternative  1  and  therefore  can  report  that  it  is  the  more  cost  ef¬ 
fective.  Be  aware,  however,  that  if  a  criterion  level  of  effectiveness  has 
been  established,  you  may  be  spending  money  needlessly  on  effectiveness  that 
exceeds  that  criterion. 

7 .  Resolve  Issues 

Some  issues  may  have  been  posed  as  questions  in  your  authorizing  letter 
of  instruction.  For  example,  you  are  asked  to  assess  two  installations,  X  and 
Y,  as  to  suitability  for  live  fire  target  practice.  You  find  that  only  X  has  in 
existence  a  usable  range.  Energy  costs  are  lower  at  Y,  construction  costs  lower 
at  Y,  but  environmental  impact  is  not  favorable. 

Another  issue  you  address  is  trainability.  (You  assess  this  factor 
using  method  in  III.F.3,  p.  Ill- 137.)  The  tasks  of  target  acqusition,  tracking, 
and  engaging  are  among  the  most  critical.  On  examination  of  the  personnel  capa¬ 
bilities  and  the  two  analogous  training  programs,  you  find  that  the  majority  of 
trainees  are  trained  to  criterion.  Since  System  X  has  features  such  as  the  new 
scanning,  acquisition,  and  tracking  subsystems  and  improved  IR  lock-on  capa¬ 
bility,  you  have  good  reason  to  believe  that  it  will  be  easier  to  operate  and 
be  more  effective.  Therefore,  although  task  criticality  is  high,  training  risk 
is  judged  low  and  you  report  that  on  the  issue  of  task  trainability,  there  is 
little  concern. 
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8 .  Prepare  Report 

The  last  step  in  the  CTEA  process  is  the  preparation  of  a  clear,  com¬ 
prehensive,  well-documented  report  on  the  findings  with  recommendations  as 
warranted . 

Formats  will  vary  but  such  recent  CTEA  reports  as  the  DIVAD  Gun  (1979) 
and  the  U.  S.  ROLAND  Missile  System  (1978)  can  serve  as  models.  You  will  want 
to  refer  to  the  TRADOC  Training  Effectiveness  Analysis  Handbook  as  well. 

Once  completed,  your  report  will  serve  both  as  an  aid  to  decision 
makers  and  also  as  a  basis  or  starting  point  for  all  other  requirements  for 
CTEA  input  during  the  life  of  System  X. 
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MEDIA  RELATED  VARIABLES 


STIMULI  CHARACTERISTICS 
Medium  of  Stimuli  Presentation 

Visual  Cues  -  Signals  received  through  the  sense  of  sight. 

2.  Audio  Cues  -  Signals  received  through  the  sense  of  hearing. 

3.  Tactile  Cues  -  Signals  received  through  the  sense  of  touch,  including 
sensations  related  to  texture,  size,  shape,  or  vibration  of  the  skin. 

4.  External  Stimulus  Motion  Cues  -  The  sensations  felt  by  a  person  when 
he  is  moved  by  some  outside  force  in  such  a  way  that  his  body  experiences 
roll,  pitch,  yaw,  heave,  sway  and/or  surge. 

5.  Internal  Stimulus  Motion  Cues  -  The  sensations  felt  by  a  person  when 
he  moves  his  arm,  leg,  lingers,  etc. 

6.  Olfactile  Cues  -  Signals  received  through  the  sense  of  smell. 

7.  Gustatile  Cues  -  Signals  received  through  the  sense  of  taste. 

Visual  Form 

8.  Visual  Alphanumeric  -  Words  and/or  numbers  presented  visually. 

9.  Visual  Symbolic  -  Symbols  presented  graphically. 

10.  Visual  Graphic  -  Two-dimensional  figures,  such  as  maps,  graphs, 
mathematical  curves,  etc.,  presented  visually. 

11.  Visual  Pictorial  -  Two-dimensional  images,  such  as  photographs, 
drawings,  etc.,  presented  visually. 

12.  Visual  Solid  Object  -  A  three-dimensional  image  or  reality  that  is 
viewed  from  exterior  perspecti ves. 

13.  Visual  Environment  -  A  three-dimensional  image  or  reality  that  is 
v i ewed  from  inside.  ” 

Visual  Movement 

14.  Visual  Still  -  A  static  visual  field,  as  with  a  still  photograph, 
drawing  or  printed  page. 

15.  Visual  Limited  Movement  -  A  basically  static  visual  field  with  elements 
that  can  be  made  to  move,  as  with  an  animated  transparency  or  simple  panel 
with  switches  that  move. 
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16.  Visual  Full  Movement  -  A  visual  field  in  which  all  elements  can  move, 
as  with  a  motion  picture,  flight  simulator,  or  operational  aircraft. 

17.  Visual  Cyclic  Movement  -  A  visual  field  which  moves  through  a  fixed 
sequence  and  then  repeats  the  sequence  in  a  repetitive  manner,  as  with  a 
film  loop. 

Visual  Spectrum 

18.  Black  and  White  -  A  visual  field  composed  of  either  black  or  white 
elements,  as  with  the  printed  page  or  line  drawings. 

19.  Gray  Scale  -  A  visual  field  composed  of  black,  white  and  continuous 
gradations  of  gray ,  as  with  a  black  and  white  photograph  or  television 
picture. 

20.  Color  -  A  visual  vield  composed  of  various  segments  of  the  visual 
spectrum,  as  with  color  television  or  motion  pictures. 

Visual  Scale 

21.  Exact  Scale  -  Actual  visual  field  or  a  one-to-one  replication  of 
that  field  as  with  a  full-sized  mock-up,  simulator,  or  operational  system. 

22.  Proportional  Scale  -  A  representation  of  reality  in  other  than 
full  scalej  such  as  a  scaled  model  map  or  photograph. 

Visual  Contrast 

23.  Dim  -  A  visual  object  which  blends  in  with  its  background,  i.e., 
there  is  a  small  or  no  luminance  difference  between  an  object  and  its 
background. 

24.  Bright  -  A  visual  object  which  is  brighter  than  its  background, 
i.e.  /  there  is  a  large  luminance  difference  between  an  object  and 
its  background. 

Audio  Sources 

25.  Tonal  Sound  -  A  very  limited  source  of  sound  or  noise  which  is  used, 
rather  than  speech,  for  signaling  or  warning,  e.g.,  horns,  whistles,  sirens, 
bells,  buzzers,  etc. 

26.  Voice  Sound  -  A  limited  source  of  sound  which  enables  spoken  words 
to  be  used  as  the  medium  of  communications,  but  not  suited  to  more 
demanding  tasks,  such  as  music  or  sound  recognition  exercises. 

27.  Full  Sound  -  A  source  of  sound  that  contains  all  the  significant 
elements  of  the  sound  and  is  suited  to  the  demanding  task  of  sound 
recognition  exercises. 
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28.  Ambient  Sound  -  A  complex  sound  environment  with  sounds  emanating 
from  various  sources  and  from  various  directions,  including  background 
noise  and  task  significant  sounds. 

Audio  Stimuli  Intensity 

29.  Weak  -  Audio  stimuli  presented  to  the  trainee  which  have  weak  intensity 

30.  Strong  -  Audio  stimuli  presented  to  the  trainee  which  have  strong 
intensity. 

Stimuli  Presentation 

31.  Static  -  A  unitary  stimuli  situation,  i.e.,  stimuli  are  presented  to 
the  trainee  "all  at  once",  e.g. ,  batch  presentations. 

32.  Dynamic-Ordered  -  A  sequential  stimuli  situation,  i.e.,  stimuli  are 
presented  to  the  trainee  sequentially  or  in  an  ordered  manner  over  time. 

33.  Dynamic- Random  -  A  non-sequential  stimuli  situation,  i.e.,  stimuli 
are  presented  to  the  trainee  randomly  over  time. 

Stimuli  Presentation  Rate 

34.  Slow  Rate  -  A  slow  rate  or  speed  of  presentation  of  stimuli  to  the 
trainee,  allowing  the  trainee  a  long  or  maximum  stimulus  analysis  time. 

35.  Fast  Rate  -  A  fast  rate  or  speed  of  presentation  of  stimuli  to  the 
trainee,  allowing  the  trainee  a  short  or  minimum  stimulus  analysis  time. 

Number  of  Channels  or  Sources 

36.  Limited  -  A  small  number  of  sources,  channels,  or  instruments 
through  which  stimuli  are  presented  to  the  trainee. 

37.  Unlimited  -  A  multiple  number  of  sources,  channels,  or  instruments 
through  which  stimuli  are  presented  to  the  trainee. 

Stimuli  Distribution 

38.  Individual  -  All  information  is  presented  directly  to  one  individual 
trainee. 


39.  Group  -  Information  is  presented  to  a  group  of  trainees,  allowing  only 
indirect  access  to  the  information  for  an  individual. 
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MEDIA  RELATED  VARIABLES 


RESPONSE  CHARACTERISTICS 
Response  Mode  of  Implementation 

1.  Overt  Response  -  Verbal  -  A  response  which  the  trainee  expresses  in  an 
audible  (verbal)  manner,  such  as  a  verbal  short  answer  response  to  a  question 
having  a  limited  set  of  correct  answers,  a  conversational  response,  or  a 
verbal  decision  response. 

2.  Overt  Response  -  Written  -  A  response  which  the  trainee  expresses 

in  an  observable  (written)  manner,  such  as  a  free  style  written  response, 
a  written  multiple  choice  response,  or  a  written  fill-in-the  blank  response. 

.  Overt  Response  -  Manipulative  Acts  -  A  response  which  the  trainee  expresses 
in  an  observable  (manipulative)  manner,  such  as  the  small  movements  of  dials, 
switches,  keys,  cr  small  adjustments  to  instruments  or  the  large  movements  of 
levers,  wheels  or  use  of  hand  held  tools. 

4.  Overt  Response  -  Tracking  -  A  response  which  the  trainee  expresses  in  an 
observable  (tracking)  manner,  such  as  continuously  controlling  a  constantly 
changing  system,  e.g.,  steering  an  automobile. 

5.  Overt  Response  -  Procedural  Performance  -  A  response  which  the  trainee 
expresses  in  an  observable  (procedural"  performance)  manner,  such  as 
performing  a  sequence  of  steps  in  a  procedure,  e.g.,  carrying  out  the  items 
on  the  checklist  for  preflighting  an  aircraft  or  turning  on  a  radar  system. 

Intensity  of  Response 

Weak  -  Responses  made  by  the  trainee  with  weak  intensity. 

7.  Strong  -  Responses  made  by  the  trainee  with  strong  intensity. 

Response  Implementation 

8.  Static  -  A  unitary  response  situation,  i.e.,  responses  are  made  by  the 
trainee  "all  at  once". 

9.  Dynamic-Ordered  -  A  sequential  response  situation,  i.e.,  responses  are 
made  by  the  trainee  sequentially  or  in  an  ordered  manner  over  time. 

10.  Dynamic-Random  -  A  non-sequential  response  situation,  i.e.,  responses 
are  made  by  the  trainee  randomly  over  time. 


Required  Response  Rate 


11 .  Slow  Rate  -  A  slow  rate  or  speed  of  trainee  response,  i.e.,  a  rate  which 
allows  the  trainee  a  long  or  maximum  response  time. 

12.  Fast  Rate  -  A  fast  rate  or  speed  of  trainee  response,  i.e.,  a  rate  which 
allows  the  trainee  a  short  or  minimum  response  time. 

Mumber  of  Response  Channels 

13.  Limited  -  A  limited  number  of  sources,  channels,  or  instruments  through 
which  required  responses  are  made  by  the  trainee. 

14.  Unlimited  -  An  unlimited  number  of  sources,  channels,  or  instruments 
through  which  responses  are  made  by  the  trainee. 

Response  Distribution 

15.  Individual  -  One  individual  trainee  makes  the  required  response. 

16.  Group  -  A  group  of  trainees  make  the  required  response. 
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MEDIA  RhLATED  VARIABLES 


INFORMATION  FEEDBACK  LOGIC 
Medium  of  Feedback  Presentation 


1.  Visual  -  Feedback  presented  visually  by  means  of  a  display,  it  may  be 
coded  and  transmitted  visually  to  the  trainee. 

2.  Aural  -  Feedback  presented  aurally  by  means  of  a  display  to  the  trainee. 

3.  Written  Form  -  Feedback  presented  to  the  trainee  in  written  form. 

4.  Face-to-Face  Communication  -  Feedback  presented  by  direct  verbal  means 
to  the  trainee. 

j.  Indirect  Communication  -  Feedback  presented  by  indirect  verbal  means, 
such  as  by  intercom,  telephone,  or  radio  link. 

6.  Tactile  -  Feedback  presented  to  the  trainee  through  the  sense  of  touch, 
including  sensations  related  to  texture,  shape,  size,  or  vibration  of  the  skin. 

7.  Kinesthetic  -  Feedback  presented  to  the  trainee  by  either  internal  or 
external  bodily  movement,  such  as  reaching,  grasping,  tilting,  etc. 

8.  01  tactile  -  Feedback  presented  to  the  trainee  through  the  sense  of  smell. 

9.  Gustati le  -  Feedback  presented  to  the  trainee  through  the  sense  of  taste. 
Source  of  Feedback 

10.  Intrinsic  F  -  Information  or  cues  built  into  the  system  from  which  the 
.rainee  interprets  feedback  information. 

11.  Extrinsic  F  -  Information  or  cues  not  inherent  in  the  trainee  action  or 
system  operations  but  is  supplied  by  an  external  source. 

Type  of  Feedback 

12.  Research  Correctness  (Rcr)  -  Information  about  the  correctness  or 
incorrectness  of  trainee’s  response,  when  several  response  alternatives  are 
possible  and  the  correct  choice  is  not  known  to  the  trainee  in  advance. 

'Also  known  as  augmented  feedback.; 

Response  Correctness  (RcfJ  -  Information  provided  to  the  trainee  (or 
>r<;  wno  need  to  know  about  his  performance)  that  he  has  in  fact  performed 
j  but  does  not  say  anything  about  the  longer  range  consequences 

■  ’  ■  <■  action  taken. 
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14.  Response  Consequences  (Ren)  -  Information  about  the  consequences  of  the 
action  taken.  It  confirms  the  response  made  by  the  trainee,  and  the 
correctness  of  a  response  can  be  inferred  only  from  its  consequences.  May 
also  serve  to  cue  the  trainee  to  perform  the  next  response  in  sequence. 

15.  System  Status  (Rss)  -  Information  about  the  condition  of  one’s  own 
or  another  system  or  the  external  environment,  on  the  basis  of  which  a 
trainee  or  team  must  act.  Information  is  not  necessarily  (or  even  frequently) 
the  immediate  consequence  of  or  follow-on  to  a  specific  trainee/team  action; 
it  may  reflect  system  events  that  have  been  put  in  motion  by  much  earlier 
trainee  actions.  Provides  information  that  regulates  trainee  and  system 
actions  in  the  sense  that  when  a  particular  status  condition  occurs,  the 
trainee  must  often  take  action  to  maintain  the  integrity  of  his  system. 

Feedback  Distribution 

16.  Individual  -  Feedback  is  presented  to  one  individual  trainee. 

17.  Group  -  Feedback  is  presented  to  a  group  of  trainees,  allowing  only 
indirect  access  for  an  individual. 
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FUNCTIONAL  CONTEXT  VARIABLES 


ROLE  OF  ELEMENT  -  The  social  function  performed  by  the  trainee  within  the 
system’s  operational  context. 

1.  Supervisory  -  The  trainee's  function  is  unequal  to  functions  being 
performed  by  other  individuals;  the  role  is  basically  one  of  overseeing  or 
directing. 

2.  Team  Performance  -  The  trainee's  function  is  equal  to  functions  being 
performed  by  other  individuals;  the  function  is  basically  one  of  teamwork 
and  cooperation. 

3.  Individual  Performance  -  The  trainee’s  function  is  one  of  performing 
alone,  usually  without  supervision  or  team  assistance. 

FUNCTION  PERFORMED  IN  ROLE  -  The  primary  actions  performed  within  each  role. 

4.  Mental  -  An  action  occurring  or  experienced  in  the  trainee's  mind,  as 
contrasted  with  overt  physical  activity. 

5.  Physical  -  An  overt  bodily  action  performed  by  the  trainee. 

6.  Perceptual  -  An  action  by  the  trainee  involving  perception  or  observation. 

7.  Communicative  -  An  action  by  the  trainee  in  which  he  transmits  either  a 
written  or  verbal  message. 

STABILITY  OF  FUNCTION  -  The  function's  state,  quality,  or  degree  of  being 
constant  overtime. 

8.  Unstable  -  The  trainee's  function  is  not  constant  or  regular,  it  is 
characterized  by  continual  change  and  fluctuation. 

9.  Stable  -  The  trainee's  function  has  little  change  or  fluctuation  over  time. 

.PHYSICAL  CONTEXT  -  The  significance  of  the  physical  environment  upon 
performance  of  the  task. 

10.  Low  Impact  -  The  physical  environment  has  little  or  no  significant 
impact  on  performance  of  the  task. 

11.  High  Impact  -  The  physical  environment  has  a  large  or  significant  impact 
on  performance  of  the  task. 

PSYCHOLOGICAL  IMPACT  -  The  significance  of  the  psychological  environment 
upon  performance  of  the  task. 
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12.  Low  Impact  -  The  psychological  environment  has  little  or  no  significant 
impact  on  performance  of  the  tas  . 

13.  High  Impact  -  The  psychological  environment  has  a  large  or  significant 
impact  on  performance  of  the  task. 
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TRAINING  EQUIPMENT  ft  MATERIALS 


Visual  Only  Systems 

1.  Case  Study  Folders  -  Folders  with  illustrative  studies  showing  cause 
and  effect  information,  may  include  pictures,  graphs,  maps,  charts,  etc. 

2.  Flash  Cards  -  A  set  or  deck  of  cards  designed  to  present  information 
to  a  group  or  individual  student. 

3.  Printed  Materials  -  Handouts  -  Handouts  are  a  class  of  printed 
materials  issued  to  a  student  for  his  use  and  retention  to  augment  regular 
instructional  materials.  They  are  usually  instructor  prepared,  machine 
copied  materials  of  one  or  two  pages  highlighting  specific  topics  or 
updating  existing  materials. 

4.  Printed  Materials  -  Performance  Aids  -  Performance  aids  are  a  class 
of  printed  materials  that  display  data  to  aid  in  job  performance  or  to 
identify  facts  or  background  information.  They  include  conversion 
tables,  data  charts,  schematic  diagrams,  equipment  test  tolerance  matrices, 
checklist  routines,  maps,  and  the  like. 

5.  Printed  Materials  -  Reference  Books  -  Reference  books  are  a  class  of 
printed  materials  used  to  identify  certain  facts  or  for  background 
information  such  as  dictionaries,  encyclopedias,  technical  publications, 
guides  or  manuals. 

6.  Printed  Materials  -  Workbooks  and  Exercises  -  A  class  of  printed 
materials  used  to  augment  or  replace  instructional  texts  by  providing  a 
mix  of  text  information  and/or  practice  exercises  and  quizzes. 

7.  Printed  Materials  -  Textbooks  -  Textbooks  are  a  class  of  printed 
material  dealing  with  a  subject  of  study  and  used  as  a  principal  source 
of  organized  information. 

8.  Programmed  Text  -  A  printed  text  containing  frames  of  information, 
either  in  the  form  of  questions  requiring  the  trainee  to  construct  simple 
written  responses,  multiple  choice  questions,  etc.  The  material  is 
carefully  sequenced,  tested,  and  revised  to  ensure  that  a  specific  student 
population  will  achieve  stated  behavioral  objectives  with  a  predetermined 
level  of  success. 

?.  Filmstrip  Projection  System  -  A  single  frame  projector  or  attachment 
thereto  that  will  accept  a  filmstrip  format  and  project  the  film 
images  upon  a  viewinq  screen. 

10.  Microform  -  Microimagery,  such  as  microfilm,  used  as  a  medium  of 
instruction. 
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11.  Overhead  Projection  System  -  A  system  consisting  of  a  horizontal 
stage  projector  designed  to  use  a  vertical  throw  for  focusing  an 
enlarged  transparency  image  upon  a  projection  screen. 

12.  Slide  Projector  System  -  2"  x  2"  -  A  class  of  single  frame  picture 
projectors  that  will  accept  a  standard  2"  x  2"  slide  and  project  the 
contained  image  upon  a  viewing  screen. 

Audio  Only  Systems 

13.  Audio  Disc  System  -  An  audio  system  that  uses  a  record  player  and 
sound  recorded  on  a  disc  (record). 

14.  Audio  Tape  System  -  An  audio  system  that  uses  a  tape  recorder/ 
reproducer  to  record  sound  on  magnetic  tape. 

15.  Language  Laboratory  -  Audio  -  An  audio  presentational  device  that 
distributes* audio- information  via  a  control  console  to  student  stations 
equipped  with  headsets,  and  may  have  a  microphone  for  console/instructor- 
student  intercommunication  and  a  tape  recorder.  Student  may  interact 
with  taped  instructional  material,  rewind  and  play  back  or  store  responses. 
Student  responses  may  be  monitored  or  recorded  at  console. 

16.  Radio  System  -  AM/FM  -  A  passive  audio  system  consisting  of  a 
broadcast  studio,  transmitting  station,  and  student  radio  receivers. 

The  system  uses  designated  AM/FM  frequency  bands  for  information 
transmission. 

17.  Radio  System  with  Responders  -  A  multi-channel  two-way  radio 
communication  system  that  operates  within  UHF  or  VHF-FM  frequency  bands 
limiting  broadcast  ranges.  Network  may  be  open  or  use  encodino/ 
decoding  techniques  or  responders  for  individual  channel  privacy. 

18.  Telephone  System  -  A  telephone  system  with  switching  matrix 
capability  that  allows  multiple  station  two-way  audio  communication 
at  two  or  more  remote  locations. 


Audio-Visual  Systems 

19.  Carrel  -  A  small  enclosure  or  alcove  incorporating  a  desk,  can 
be  used  by  one  or  two  trainees  and  can  be  equipped  with  AV  equip¬ 
ment  or  tools  or  print  materials  or  a  combination  of  these. 

20.  Dial  Access  Information  Retrieval  System  -  Audio/Video  -  Dial 
access  information  retrieval  is  an  electronic  system  for  distributi ng 
audio  and/or  visual  materials  and  programs  which  are  stored  in  a 
location  remote  from  where  they  are  dialed  and  received. 

21.  Filmstrip  Projection  System  with  Audio  -  A  sound  filmstrip 
projector  represents  a  family  of  audio-visual  devices  using  single 
frame  visual  filmstrips  with  sound  on  magnetic  tape  or  records. 

Visuals  and  sound  may  be  manually  or  automatically  synchronised. 

Commercial  equipment  options  include  front  or  rear  screen  projection, 
remote  and  stop  action  capability,  and  cartridge  loading  models. 

22.  Microform  with  Audio  -  Microimagery,  such  as  microfilm,  used  as  a 
medium  of  instruction with  audio  tape  or  disc,  etc. 

23.  Motion  Picture  Projection  System  -  16MM  and  Super  8MM  Films  - 
A  motion  picture  projection  system  using  professional ly  or  locally 
prepared  16mm  or  S-8mm  sound  motion  picture  films  for  training. 

Appropriate  16mm  or  S-8mm  projector  and  projection  screen  are 
included. 

24.  Sound  Slide  Projection  System  -  A  system  for  presenting  infor¬ 
ma  tiorT371iiians^Flinliu^io~tapi-?nd  a  series  of  synchronized 
projected  visual  slides. 

25.  Teaching  Machine  -  Still  Visual/Audio  -  An  individualized  instruction 
system  composed  of  programmed  instruction  still  frames,  such  as  large 
step  multiple  choice  or  fixed  linear  sequence,  and/or  synchronized  sound, 
and  a  manually  controlled  device  to  display  the  audio  and/or  visual 
information. 

26.  Teaching  Machine  -  Motion  Visual/Audio  -  An  individualized  instruction 
system  composed. of  programmed  instruction  motion  frames,  such  as  large 
step  multiple  choice  or  fixed  linear  sequence,  and/or  synchronized 

sound,  and  a  manually  controlled  device  to  display  the  audio  and/or 
visual  information. 


27.  Televideo  System  -  A  telecommunication  system  that  allows  audio 
and  visual  two-way  communication  between  two  or  more  remote  locations. 


28.  Television  -  Cable  (CATV)  -  A  hybrid  CCTV  system  offering  selective, 
multiple  channel,  encoded  programming  to  cable  network  patrons.  A 
typical  system  consists  of  a  signal  receiving  antenna  system  for  the 
master  station  and  relav  of  amplified  signal  channels  via  area  substations 
to  system  subscribers.  Programming  may  also  be  generated  and  transmitted 
between  substations  offering  multiple  options  for  conference  or  training. 
Programs  are  encoded  for  privacy  and  control  of  viewing  audience. 

29.  Television  -  Cartridge  (CTV)  -  A  cartridge  television  system  (CTV) 
consists  of  packaged  video  tape  programs,  video  recorder,  playback 

and  display  units,  and  control  equipment  offering  high  selectivity 
and  availability  for  individualized  programming.  Program  cartridges 
may  be  prerecorded,  locally  produced,  or  recorded  off-the-air. 

30.  Television  -  Closed  Circuit  (CCTV)  -  CCTV  is  an  electronic  transmission 
system  for  images  and  sound  using  a  coaxial  cable  distribution  system. 

System  design  includes  one  or  more  studios  or  control  rooms,  a  signal 
distribution  center,  and  signal  distribution  cables  terminating  in 
reception  areas  equipped  with  receiver/monitors.  Off  air,  live  or 

video  taped  programs  may  be  used. 

31 .  Television  -  Non-Magnetic  Video  Disc  Svstem  -  An  experimental 

form  of  television,  simiVar  in  function  to  cartridge  television,  in  which 
the  program  is  encoded  on  a  thin  plastic  disc,  distributed  to  users  where 
it  is  rotated  at  high  revolutions  per  minute  on  a  player  which  reads 
the  data  and  sends  program  signals  into  the  antenna  terminals  of  a 
standard  color  television  receiver.  Random  access  capability. 

32.  Computer  -  A  programmable  electronic  device  that  can  store,  retrieve, 
and  process  data.  It  may  manage  and  display  information  to  a  student, 
accept  student  responses,  provide  feedback,  perform  calculations,  etc. 

33.  Demonstrator  -  A  low  fidelity  simulator  that  demonstrates  manipulative 
principles,  movement  in  time  or  space,  steps  of  a  procedure,  etc. 

34.  Mock-up  and  Panel  -  A  training  aid  used  to  demonstrate  relative 
shape,  size,  composition  or  function  of  an  object  or  system  display. 

It  may  have  moving  parts,  such  as  dials,  switches,  levers,  etc.,  or  have 
non-moving  parts,  such  as  cutaway  or  layout  models,  etc. 

35.  Operational  Equipment  -  A  unit  of  or  the  entire  equipment  used  on 
the  job  for  training  purposes  where  extreme  fidelity  is  reauired. 

36.  Physiological  Trainers  (Hostile  Environment)  Auditory  -  training 
devices  designed  to  place  controlled  stress  on  the  human  hearing  system 
through  use  of  a  physiologically  and/or  psychologically  adverse  sound 
environment,  to  enable  a  trainee  to  learn  to  function  in  this  adverse 
environment. 


37.  Physiological  Trainers  (Hostile  Environment)  Visual  -  A  training 
device  designed  to  place  controlled  stress  on  the  human  visual  system, 
through  the  use  of  physiologically  and/or  psychologically  adverse  or 
low  threshold  visual  signals,'  to  enable  a  trainee  to  learn  to  function 
in  this  adverse  environment. 

38.  Physiological  Trainers  (Hostile  Environment)  Surface  and  Internal 
Senses  -  A  broad  category  of  training-  device?  designed  to  provide  the 
cutaneous,  kinesthetic  and  olfactory  sensors  with  physiologically  and/ 
or  psychologically  adverse  signals,  to  enable  a  trainee  to  function 

in  adverse  pressure,  temperature,  pain  or  disorientating  motion  environ¬ 
ments. 
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Appendix  6 
Training  Methods 


1.  Lecture-Standard:  A  semiformal  discourse  in  which  the  instructor  presents 
a  series  of  events,  facts,  concepts,  or  principles;  explores  a  problem;  or 
explains  relationships.  Trainees  participate  in  a  lecture  mainly  as 
listeners.  A  lecture  is  basically  a  means  of  "telling"  trainees  information 
they  need  to  know.  Not  all  talking  done  by  an  instructor  during  a  class 
period  can  be  termed  a  lecture,  the  term  describes  a  more  formal  presentation 
used  to  achieve  an  instructional  objective. 

2.  Lecture-Team  Teach:  A  semiformal  discourse  in  which  two  (or  more)  instructors 
present  a  series  of  events,  facts,  concepts,  or  principles;  explore  a  problem; 
or  explain  relationships.  Trainees  participate  in  a  lecture  mainly  as 
listeners.  A  lecture  is  basically  a  means  of  "telling"  trainees  information 
they  need  to  know.  Not  all  the  talking  done  by  the  instructors  during  a  class 
period  can  be  termed  a  lecture,  the  team  describes  a  more  formal  presentation 
used  to  achieve  an  instructional  objective. 

3.  Conference-Directed  Discussion:  Group  discussion  techniques  are  used  to  reach 
instructional  objectives.  These  techniques  include  questions,  answers,  and 
comments  from  the  instructor  in  combination  with  answers,  comments,  and 
questions  from  the  trainees,  and  are  directed  toward  attainment  of  learning 
goals.  The  objective  in  directed  discussion  is  to  help  trainees  acquire 
better  understanding  and  the  ability  to  apply  known  facts,  principles, 
concepts,  policies,  or  procedures,  or  to  provide  trainees  with  an  opportunity 
to  apply  their  knowledge.  The  function  of  the  instructor  is  to  guide  the 
discussion  in  such  a  way  that  the  facts  principles,  concepts,  or  procedures 
are  clearly  articulated  and  applied. 

4.  Conference-Seminar:  Group  discussion  techniques  are  used  to  reach  instruc¬ 
tional  objectives.  These  techniques  include  questions,  answers,  and  comments 
from  the  instructor  in  combination  with  answers,  comments,  and  questions  from 
the  trainees,  and  are  directed  toward  attainment  of  learning  goals.  The 
purpose  of  the  seminar  is  to  find  an  answer  to  a  question  or  a  solution  to  a 
problem.  The  instructor  does  not  have  an  answer  or  solution;  in  fact  there 
is  no  known  best  or  correct  solution.  Rather,  he  is  seeking  an  answer,  and 
he  uses  the  group  to  develop  one.  The  primary  functions  of  the  instructor 
are  to  describe  the  problem  as  he  understands  it  and  to  encourage  free  and 
full  participation  in  a  discussion  aimed  at  (1)  identifying  the  real  problem, 
(2)  gathering  and  analyzing  data,  (3)  formulating  and  testing  hypotheses,  (4) 
determining  and  evaluating  alternative  courses  of  action,  (5)  arriving  at 
conclusions,  and  (6)  making  recommendations  to  support  or  arrive  at  a  solution 
or  a  decision. 
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5.  Demonstration:  The  instructor  actually  performs  an  operation  or  does  a  job, 
thereby  showing  the  trainee  what  to  do  and  how  to  do  it;  he  then  uses 
explanations  to  point  out  why,  where,  and  when  it  is  done.  Usually,  the 
trainee  is  expected  to  be  able  to  repeat  the  job  or  operation  after  the 
demonstration. 

6.  Performance-Manual-Independent  Practice:  A  method  in  which  the  trainee  is 
required  to  perform  under  controlled  conditions,  the  operation,  skill,  or 
movement  being  taught.  Performance  is  learning  by  doing.  In  independent 
practice,  trainees  work  individually  and  at  their  own  rate. 

7.  Performance-Manual-Student  Tutor:  A  method  in  which  the  trainee  is  required 
to  perform  under  controlled  conditions,  the  operation,  skill,  or  movement 
being  taught.  Performance  is  learning  by  doing.  In  the  student  tutor 
method,  trainees  are  paired  and  members  of  each  pair  perform  alternately  as 
instructor  and  trainee. 

8.  Performance-Manual-Group  Practice:  A  method  in  which  the  trainee  is  required 
to  perform  under  controlled  conditions,  the  operation,  skill,  or  movement 
being  taught.  Performance  is  learning  by  doing.  In  group  performance,  a 
group  of  trainees  perform  an  operation  or  function  involving  teamwork. 

9.  Performance-Manual-Group  Controlled  Practice:  A  method  in  which  the  trainee 
is  required  to  perform  under  controlled  conditions,  the  operation,  skill,  or 
movement  being  taught.  Performance  is  learning  by  doing.  In  group  controlled 
practice,  trainees  work  together  at  the  rate  set  by  the  instructor,  step  by 
step  and  "by  the  numbers". 

10.  Programmed  Instruction:  A  method  of  self-instruction  in  which  the  trainee 
works  through  a  carefully  sequenced  and  pretested  series  of  steps  leading 
to  the  acquisition  of  knowledge  or  skills  representing  the  instructional 
objectives.  The  trainee  proceeds  through  the  program  at  his  own  rate, 
responds  actively  (or  covertly)  to  each  step  in  the  sequence,  and  receives 
immediate  feedback  on  the  correctness  of  his  response  before  proceeding  to 
the  next  step.  Programs  are  usually  designed  to  permit  the  trainee  to 
master  the  desired  knowledge  or  skills. 

11.  Study  Assignment-Individual  Study:  In  the  study  assignment  method,  the 

instructor  assigns  readings  in  books,  periodicals,  manuals,  or  handouts; 
requires  the  completion  of  a  project  or  research  paper;  or  prescribes 

problems  and  exercises  for  the  practice  of  a  skill.  In  independent  study, 

the  trainee  carries  out  the  assignment  without  instructor  assistance  or 
direct  guidance. 

12.  Study  Assignment-Supervised  Study:  In  the  study  assignment  method,  the 

instructor  assigns  readings  in  books,  periodicals,  manuals,  or  handouts; 
requires  the  completion  of  a  project  or  research  paper;  or  prescribes 

problems  and  exercises  for  the  practice  of  a  skill.  In  supervised  study, 

the  trainee  carries  out  the  assignment  with  an  instructor  available  for 
guidance  and  assistance. 
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13.  Tutoring:  An  instructor  works  directly  with  an  individual  trainee.  The 
method  may  involve  exposition,  demonstration,  questioning,  coaching,  or 
guided  practice. 

14.  Case  Study:  Involves  in-depth  group  discussion  of  real-life  situations.  It 
requires  reading,  study,  analysis,  discussion,  and  free  exchange  of  ideas  as 
well  as  decision  making  and  the  selling  of  decisions  to  others.  A  case  report 
is  distributed  to  trainees.  The  report  contains  a  factual  and  accurate  picture, 
based  on  firsthand  observation,  of  a  situation  that  portrays  people  acting, 
interacting,  and  reacting.  Trainees  study  the  case  report  and  discuss  it  in 
depth. 

15.  Incident  Method:  A  variation  of  the  case  method  in  which  only  a  brief  sketch 
of  the  climax  of  a  case  is  presented.  Trainees  are  given  a  few  minutes  to 
study  the  incident  and  attempt  to  determine  the  information  they  need  to  find 
out  what  is  going  on.  Trainees  then  get  these  facts  by  asking  questions  of 
the  leader.  Time  is  usually  limited,  and  questions  must  be  of  the  type  that 
can  be  answered  "yes"  or  "no",  or  by  a  simple  factual  statement.  The  group 
then  determines  the  nature  of  the  problem  and  the  decisions  needed  to  solve 
it.  Each  member  writes  an  individual  decision  with  supporting  reasons.  Group 
discussion  of  the  case  in  general  and  the  decisions  reached  follows. 

16.  Role  Playing:  A  laboratory  method  of  instruction  that  involves  the  sponaneous 
dramatization  or  acting  out  of  a  situation  by  two  or  more  persons  under  the 
direction  of  a  trainer.  The  dialog  grows  out  of  the  situation  developed  by 
the  trainees  assigned  to  the  parts.  Each  person  acts  his  role  as  he  feels  it 
should  be  played.  Other  trainees  serve  as  observers  and  critics.  Following 
the  enactmenc,  the  group  engages  in  discussion. 

17.  Sensitivity  (Laboratory  or  T-Group)  Training:  A  deliberate  effort  to  apply 
behavioral  science  to  problems  of  motivation,  communication,  problem  solving, 
and  teamwork.  Basically,  sensitivity  training  is  small-group  interaction 
under  stress  in  an  unstructured  group  composed  of  learners  and  a  trainer.  The 
objective  is  behavioral  change.  To  attain  the  objective,  a  permissive  or 
supportive  environment  is  established  by  the  trainer.  Participants  are 
encouraged  to  act  their  own  roles,  receive  feedback,  examine  their  concepts 

of  self,  experiment  with  and  practice  new  patterns  of  behavior,  and  learn 
how  to  maintain  changed  behavior  back  on  the  job. 

18.  Games:  Games  include  a  set  of  structured  decision-making  tasks  typical  of  a 
real-life  situation  and  provide  a  systematic  means  of  observing  and  evaluating 
trainees'  decisions.  These,  then,  are  fed  back  to  the  trainees  so  that  they 
can  judge  their  appropriateness.  Most  games  are  played  by  one  or  more  teams, 
each  composed  of  from  one  to  twenty  participants.  There  may  or  may  not  be 
interaction  between  teams.  Gaines  are  usually  played  in  periods  —  an  interval 
of  time  which  may  represent  a  month,  a  quarter,  or  a  year.  Trainees  are  given 
information  in  the  form  of  reports  or  a  scenario  and  allowed  time  to  study  the 
situation  and  make  decisions.  These  decisions  are  processed  either  by  a 
control  group  of  judges  or  by  a  computer.  The  resulting  data  or  scenario 
projections  are  returned  to  the  team  for  analysis,  and  another  decision. 
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19.  In-Basket  Exercises:  The  in-basket  situation  is  composed  of  a  representative 
sample  of  a  full  year's  performance  in  all  aspects  of  a  job.  Trainees  are 
given  background  materials,  organization  charts,  policy  manuals,  financial 
statements,  reports,  and  position  papers  to  study  before  the  exercise  begins. 
Each  trainee  is  then  exposed  to  a  structured  array  of  memos,  reports,  letters, 
telephone  calls,  visits,  and  meetings.  In  his  role  as  a  manager,  the  trainee 
makes  decisions  on  the  incoming  "mail."  In  each  instance  he  commits  himself 
in  writing  to  specific  courses  of  action.  Time  limits  are  established  to 
introduce  realism  and  cause  stress.  The  decision-making  phase  is  followed 

by  discussion  and  critique  of  the  actions  taken  and  decisions  reached.  All 
actions  are  analyzed,  evaluated,  and  fed  back  to  participants. 

20.  Brainstorming:  A  small,  carefully  selected  group  is  given  a  "how  to"  question 
or  problem  and  is  asked  to  produce  as  many  ideas  or  solutions  as  they  can 
generate.  Usually  a  time  limit  is  set.  The  technique  of  free  association  is 
encouraged.  Quantity  of  ideas  or  solutions  takes  precedence  over  quality. 
.Judgments  about  the  worth  of  ideas  or  solutions  are  deliberately  postponed 
until  a  later  time.  Ideas  are  written  on  a  chalkboard  or  flip  chart  as  fast 
as  they  are  called  out. 

21.  Committees:  A  group  of  trainees,  ranging  in  size  from  three  to  seven,  is 
given  a  special  assignment  in  the  form  of  a  problem.  The  group  is  asked  to 
investigate  the  problem,  reach  conclusions,  and  recommend  a  solution  or  a 
course  of  action.  The  committee  may  produce  a  report  which  is  often  presented 
orally  to  the  larger  group. 

22.  Field  Trips:  A  carefully  planned  visit  or  tour  to  a  place  away  from  the  train¬ 
ing  activity.  The  purpose  of  the  trip  is  to  provide  firsthand  observation  of 
objects,  processes,  operations,  and  situations  not  transportable  to,  or 
reproducible  in,  the  training  facility.  The  field  trip  may  take  less  than  an 
hour  when  it  involves  a  visit  to  an  adjoining  plant,  office,  or  shop;  or  it 
may  consume  several  days  or  weeks  as  would  be  the  case  with  a  visit  to  a 
distant  plant  or  an  overseas  installation. 

23.  Panels:  Three  to  ten  people,  under  the  direction  of  moderator,  present  their 
views  on  a  particular  subject  or  problem,  or  present  assigned  phases  of  a 
broad  topic.  Usually,  panelists  represent  different  kinds  of  expertise, 
experience,  or  perspectives.  Often  they  are  drawn  from  operating  and  staff 
elements.  At  times  experts  from  outside  the  enterprise  are  invited  to 
participate.  Sometimes  trainees  themselves  serve  as  members  of  panels. 
Following  the  presentations  by  the  panelists,  trainees  are  encouraged  to 
participate  through  questions  directed  to  individual  panelists. 
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Table  B-l-1 

TVELVI  TYPES  Of  LEARNING  ALGOAITHW  WITH  THE 
CHARACTERISTICS  Of  TRAINING  OBJECTIVES  THEY  SUPPORT 
(S.«  TAIC  taporc  23  (or  aecuol  «l(orltba.) 


MAKES  Of 
LEARNING 

CHARACTERISTICS  OP  TRAINING  OBJECTIVES  THAT  CAN  BE  ACHIEVES  WITH 
SPECIFIC  ALGORITHMS 

ACTION 

ti-LUJHl 

BEHAVIORAL  ATTRIBUTES 

mams _ 

1.  RECALLING 

Anivtr 

L.  Concarna  verbal  or 

1.  Recalling  equipment  nonan- 

BODIES  OP 

Define 

•rakollc  l*«raln(. 

datura  or  function*. 

KNOWLEDGE 

Express 

2.  Concarna  acquisition  and 

1.  Recalling  ay* tea  function* « 

I of or* 

long-term  nalncananca  of 

auch  a a  the  coop lex  rale- 

Select 

knowledge  ao  chac  it  can 
ba  racallad. 

dona  between  eyeceo  input 
end  output. 

3.  Recalling  phyalcal  lewa, 
auch  aa  Ohn's  law. 

4.  Recalling  apaclfic  radio 
fraquanclaa  and  other 
discrete  facta. 

2.  USING 

Apply 

1.  Concarna  cha  practical 

1.  Baaed  on  academic  knowledge, 

VERBAL 

Arrant* 

application  of 

dataralna  which  equipment  to 

IWPORNA- 

Choose 

inforaaclon. 

ua*  for  a  apaclfic  real 

TIOW 

Compare 

2.  Generally  follow*  tba 

world  teak. 

Decs  rains 

initial  lamming  of 
Information  through  cha 
ua*  of  the  guidelines 
for  Racallint  Bodiaa 
of  Know l«d |a. 

3.  United  uncertainty  of 
outcome. 

4.  Uaually  little  thought 
of  other  alternative*. 

2.  Based  on  an  acadaoic  knowl¬ 
edge  of  the  aye tea,  coopera 
alternative  nodes  of  opera¬ 
tion  of  a  place  of  equipment 
and  determine  the  appropri¬ 
ate  node  for  a  apaclfic  real 
world  situation. 

3.  Based  on  memorised  knowledge 
of  radio  fraquanclaa,  chooaa 
cha  correct  frequency  la  a 
apaclfic  real  world  situa¬ 
tion. 

3.  RULE 

Choose 

1.  Choosing  a  court*  of 

1.  Apply  th*  "rule*  of  the 

LEARNING 

Cone I ud a 

action  baaed  on  apply- 

road . " 

AND  USING 

Deduce 

lag  known  rules. 

2.  Soiv*  mathematical  aquation* 

Pradict 

2.  Frequently  involve# 

(both  chooelng  correct 

Propose 

"If... Then"  situation*. 

aquation  and  the  mechanic* 

Salacc 

3.  The  rules  are  not 

of  eolvlng  the  aquation) . 

Spoclfy 

questioned p  eh*  dad* Ion 
focuaaa  on  whether  cha 
correct  rule  la  being 
applied. 

3.  Carry lag  out  military 
protocol. 

4.  Selection  of  proper  tire 
extinguisher  for  different 
type  firaa. 

3.  Using  correct  grammar  In 
novel  situation#,  covered 
by  rule*. 

4.  MAKING 

Chooaa 

1.  Chooelng  a  court*  of 

1.  Choosing  fraquanclaa  to 

DECISIONS 

Design 

action  whan  alternative* 

search  in  ao  EOt  search  plan. 

Diagnose 

are  unapaciflad  or 

2.  Choosing  torpedo  eat tinge 

Develop 

unknown. 

during  a  torpedo  attack. 

Evaluate 

2.  A  succeaaful  courae  of 

3.  Threat  evaluation  and  weapon 

Poracaac 

•ctlm  la  not  rudlly 

aeelviaeat  • 

Formulae* 

apparent . 

4.  Choice  of  tactlca  In  com- 

Ortaslsa 

3.  The  panel t lea  for  unauc- 

bat  *  vide  range  of  optlona. 

Solocc 

ceaaful  coureaa  of 

3.  Chooelng  a  diagnostic 

acelon  are  not  readily 
apparent . 

4.  The  relative  value  of 
poaalbla  decisions  kic 

strategy  to  dealing  with  a 
malfunction  In  a  complex 
place  of  equipment - 
6.  Chooelng  to  abate  or  commit 

i 

b«  conel dared  -  includ¬ 
ing  poaalbla  trada-offe. 

3.  Frequently  Involve# 

forced  decision#  and*  la 

ooeeelf  to  land  upon  reach¬ 
ing  the  critical  point  la 
the  glldepath. 

) 

a  abort  period  of  cine 

i 

with  soft  Information. 

_ 
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TWELVE  TYPES  Of  LEAENING  ALGOlITtMS  WITH  THE  CHAIACTIklCT ICS 
OF  TEA  IN  INC  OBJECTIVES  THEY  SUPPORT  <coaClniM<0 
(S««  TAEG  La port  2]  (or  actual  altorlttea) 


NAMES  Of 
LlAJUflNC 

ALCOA  ITWS 

CHAKACntlSTICS  OF  TBAINING  OBJECTIVES  THAT  CAN  BE  ACHIEVED  WITH 
SPECIFIC  ALOOtmMS 

ACTION 

VMS _ BEHAVIQ1AL  ATTEI BOTES _ EXAMPLES _ _ 

5.  DETECTING 

Detact 

Distinguish 

Monitor 

. 

1.  Vigilance  -  detect  a  lev 
cue*  embedded  la  a  large 
block  of  else. 

2.  Low  threshold  cues; 
algnal  to  no lea  ratio 
nay  be  vary  low;  early 
awareness  of  nail  cuaa 

3.  Scan  for  a  wide  range  of 
cuaa  for  a  given  "target" 
and  for  different  type# 
of  "targete." 

1.  Early  eomar  dec act ion  of  a 
submarine  target. 

2.  Visually  detecting  the 
periscope  of  a  snorkel lag 
submarine  during  daytime 
opera clone  in  a  eaa  state 
of  three. 

3.  Detect,  through  a  alight 
change  in  eound,  a  bearing 
•tarring  to  burn  out  la  a 
power  generator. 

6.  CLASSIFY¬ 
ING 

Identify 

Aecognlxe 

Differ¬ 

entiate 

Clmtty 

1.  Pattern  recognition  ap¬ 
proach  of  identifica¬ 
tion  -  not  p rob lea 
solving. 

2.  Clarification  by  non¬ 
verbal  characcarlatlca. 

3.  Statue  determine t ion  - 
ready  to  etart. 

4.  Object  to  be  claeelfled 
can  be  viewed  from  aany 
perepect lvea  or  in  aany 
forme. 

1.  Classify  a  sonar  target  as 
"sub"  or  "non-eub." 

2.  Visual  classlf icat Ion  of 
flying  aircraft  as  "friend" 
or  "enemy"  or  as  an  "F-4." 

3.  Determining  chat  an  identi¬ 
fied  noise  la  a  wheal  bear¬ 
ing  failure,  not  a  water 
pump  failure  by  rating  thn 
quality  of  the  notes  -  not 
by  the  problem  solving 
approach. 

7.  IDENTIFY¬ 
ING 

SYMBOLS 

Identify 

lad 

Transcribe 

1.  Involves  the  recognition 
of  symbols. 

2.  Symbols  to  be  identified 
typically  era  of  low 
naaning fulness  to 
untrained  persona. 

3.  Idenc If teat ion i  noe 
Interpretation,  la 
sap has ltsd. 

4.  Involves  storing  queues 
of  symbolic  Information 
and  ralacad  meanings. 

1.  Beading  electronic  symbols 
on  a  schematic  drawing. 

2.  Identifying  asp  eyehole. 

3.  Beading  and  transcribing 
eymbola  on  a  tactical 
statue  board. 

4.  Idea c if y log  eyehole  on  e 
weather  nap. 

S.  VOICE 
COMMUNI¬ 
CATING 

i 

i 

1 

Advise 

Answer 

Comnlcaf 

Converse 

Direct 

Express 

In* cruet 
Interview 

Order 

Xeport 

Speak 

! 

i 

1 

{ 

1.  Speaking  and  listening 
in  specialised 

languages. 

2.  Often  involves  the  use 
of  a  epee  if le  massage 

model .  Standard 
vocabulary  and  format. 

3.  Also  concerns  clarity  of 
voice,  enunciation, 

•oeed. 

4.  Timing  of  verbalisation 
la  usually  critical  - 
whan  to  peas  informa¬ 
tion. 

5.  Typically  characterised 
by  redundancy  in  terms 
of  information  content. 

6.  Involves  as tensive  use 

of  previously  over learned 
verbal  skills,  or  over¬ 
coming  over learned  lnter- 
1  faring  pat terms, 

i  7.  Tank  may  km  difficult  due 

Kill. 

2.  Officer  giving  oral  orders 
and  receiving  reports. 

2.  Sonar  operaeor  passing  orel 
information  over  cornual- 
cation  net. 

3.  Inat ructions  by  GCA 
operator  to  pilot  in 
landing  aircraft. 
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TVE.TT  TTTCS  Of  UAMSK  OBOUSWa  WITS  TB1  CHJJLACIDU5T  ICS 

or  tiurk  owictivu  im  sonon  (cantisu«i) 

(»—  me  Uport  23  fat  »cta»l  tlforltt— ) _ 


*0* 

NAMES  OP 
LEARNING 

algorithms 

CHARACTERISTICS  OP  TRAINING  OBJECTIVES  THAI  CAN  BE  ACHIEVED  WIT1 
SPECIFIC  ALGORITHMS 

ACTION 

VERBS  BEHAVIORAL  ATTRIBUTES  EXAMPLES 

9.  RECALLING 

Activate 

1.  Coacama  the  chaining  or 

1.  Recalling  equipment 

PROCEDURES, 

Adjust 

sequencing  of  eventa. 

assembly  and  die assembly 

POSITIONING 

Align 

2.  Includes  both  tha  cognl- 

procedures. 

HOVEKENT 

AMMbll 

clva  and  no tor  aspects 

2.  Recalling  the  operation 

Calibrate 

of  equipment  **t-up  and 

and  check  out  procaduraa 

Disassemble 

opacaclng  procaduraa. 

for  a  piece  of  equipment 

Inspect 

3.  Procadural  chock  llata 

(cockpit  check  Hate) . 

Operate 

art  frequently  uaad  a a 

3.  Following  equipment  turn-on 

Service 

Job  aid*. 

procedures  -  emphasis  on 
no tor  behavior. 

10.  STEERING 

Control 

1.  Tracking,  dynamic  con- 

1.  Submarine  bow  and  •tarn 

AND 

Guido 

crol:  a  perceptual-motor 

plana  opera tore  nalntalalog 

GUIDING  - 

Monouvor 

•kill  involving  con tin- 

a  cone tent  couroe,  or 

CONTINUOUS 

Bofuloco 

uoua  pursuit  of  a  targat 

■eking  change*  In  course  pr 

MOVEMENT 

Stnr 

or  kaaplng  dial#  at  a 

depth. 

Track 

cartain  reading  each  a# 
maintaining  constant 
turn  racaa,  ate. 

2.  Compensatory  movanants 
baaed  on  feedback  fron 
displays. 

3*  Skill  In  tracking 

requires  smooth  muse la 
coordination  pattarna  - 

2.  Tank  driver  following  a 
road. 

3.  Sonar  operator  kaaplng  the 
cursor  on  a  sonar  targat. 

4.  Air-to-air  gunnery  -  target 
tracking. 

5.  Aircraft  piloting  such  aa: 

visually  following  a 
ground  path. 

lack  of  overcontrol. 

4.  Involves  tstlneclng 

c hangs*  In  positions, 
velocities,  accelera¬ 
tions,  etc. 

5.  Involves  knowledge  of 
display-control 
ralatlonahlps. 

6.  Helmsman  holding  a  course 
with  gyro  or  magnetic 
compass. 

11. PERFORMING 

Cue 

1,  Parceptual-notor 

1.  Use  of  hand  tools  such  aa 

GROSS  MOTOR 

Draft 

bahavlor-enphaaia  on 

haver,  saw,  wrench ,  or 

SKILLS 

Draw 

noeor.  Premium  on 

power  tools  such  as  lathes 

Match 

manual  dexterity,  occa- 

or  grinders. 

Mix 

•tonally  strength  and 

2.  Running  a  drill  preee  in  an 

Run 

endurance. 

assembly  line. 

Saw 

2,  Repetitive  mechanical 

3.  Loading  ammunition  into 

Sharpen 

skill. 

artillery  places  or  5" 

Spile* 

3.  Standardised  behavior. 

guns . 

Swla 

little  roon  for  varla- 

4.  Drafting  -  use  of  drafting 

Wald 

tlon  or  Innovation. 

instruments. 

Ur  lea 

4.  Automatic  behavior  - 
low  lava!  of  attention 
la  requited  In  skilled 
operator.  Klnqothptlc 
cues  dominate  control  of 
behavior. 

3.  Fatigue  or  boredom  nay 
become  a  factor  whan 
•kill  la  perforate  over 
an  extended  period  of 
cine  or  at  a  rapid  rate. 

6.  Pine  tolerance*. 

7.  Often  a  component  cf  a 

$.  Painting  -  house  painting 
or  preserving  ship  hull, 
ate. 

t.  Marching  *  close  order 
drill. 

larger  teak. 
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TWELVE  TYPES  OP  LEARNING  ALGORITHMS  WITH  THE  CHARACTERISTICS 
OP  TRAINING  OBJECTIVES  THEY  SUPPORT  (contlauad) 

(Sm  TAEG  taport  2]  t or  Actual  algorithm) 


NAMES  Of 
LEARNING 
ALGORITHMS 

CHARACTERISTICS  0?  TRAINING  OBJECTIVES  THAT  CAM  BE  ACHIEVED  WITH 
swcmc  ALGOR ITSCS 

ACTION 

VERES  BEHAVIORAL  ATTRIBUTES  EXAMPLES 

12.  ATTITUDE 
LEARNING 

Abide 

Accept 

Approve 

Comply 

Testify 

— 

1.  C o«ce roe  exhibiting  A 
pattern  of  behevlor 
cone ie tent  with  on 
attitude  or  value. 

2.  Cone erne  villlngneee  to 
per fore  according  to  e 
standard  «•  opposed  to 
skill  to  per fore  accord¬ 
ing  eo  that  standard. 

(Note:  A  person  can 

have  a  high  level  of  skill 
but  choose  not  to  perfore 
in  a  ekillf.l  manner.) 

3.  Concerns  Integrating  or 
organising  a  value  or 
attitude  into  a  pattern 
of  behavior. 

1.  Co«p lying  with  known  safety 
standards  while  performing 
a  maintenance  procedure  on 
e  high  voltage  supply  in  a 
radar  set. 

2.  Conforming  to  the  standard 
of  keeping  ooa*e  bunk  area 
neat  and  clean  whan  the 
opportunity  exists  to  do 
otherwise. 

3.  Abiding  by  aacurlcy  regu¬ 
lations  whan  handling 
classified  Information. 

4.  Accepting  the  need  to  cake 
risks  when  necessary  to 
protect  the  lives  of 

5.  Complying  with  a  request 
to  repair  a  malfunctioning 
radio  circuit  with  greater 
chan  normal  speed  when  a 
quick  response  la  required. 

ANNEX  B 
Appendix  2 

TAE6  Report  No.  16 
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INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


Directions i 

To  choose  e  delivery 

system* 

1.  Place  a  mJm  (light 
pencil)  in  boxes 
repreaanting  criteria 
(rows)  that  must  be  sat. 

2.  Selact  the  delivery 
systems  (eolusna)  that 
have  an  "X"  in  tach  row 
dasignated  by  e  mJm * 

These  ara  the  candidate 
^delivery  systems. 

Criteria  for 
Selecting 
Instructional 
Delivery 

Sy sterna 

\ 

RECALLING  BOOIES  OF  KNOWLEDGE 


Alternative  instruction* l  Delivery  lystcaa 


Delivery  Approaches 
raialttina  tha  Application 
of  All  Learning  Guidelines 
end  Algorithm 


Delivery  Approaches  NOT 
Fermitting  complete 
Application  of  learning 
Guidelines  and  Algorithm 


-*  *>  *  ms 

A  '*•  •  tJ  m 

O  >  5*  H  -  u 

e  C  >  a 

*  e  -•  «c  » 

»  s  u  U  *  *• 

o>  c  oo  a  c 

c  ■**  •*«  o  a  -x  » 

^  «m  m  sac 

£  u  0  1  u  o 

u  C  w  %.  reti  |  ^  f 

e  •  u  -•  oeoloo-o 

e  *  -  »  u  w  y  a  w  a 

t*n  z  «  a.  a  m  <  a.  « 


Stimulus  Criteria 

• 

Visual  Movement 

Halted 

Full 

• 

visual  Spectrum 

Full  Color 

• 

Audio 

voice  Sound 

Range 

Full  Sound 

Range 

Training  Setting  Criteria 

•  Individual  Trainees  at  Fixed  location 

•  Individual  Trainees  with  Simultaneous 


instruction  at  Many  lecetione 

•  Individual  Trainees  with  Independent 
Instruction  at  Any  Location 

•  Szell  Group 

•  Large  Group  at  a  Single  location 

•  Team  fatting 


Auaimstrati  vi  Criteria 

•  Sics  of  Courseware  end  special  Herd- 
war*  Development 

local 

Central 

•  Magnitude  of  Acquisition  Coat 


-*  ^  -  a 
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INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


Directional 

To  choose  a  delivery 
eyataoi 

l-  Place  a  /light 

pencil)  In  boxes 
representing  criteria 

2-  Select  the  delivery 
aysteae  (eoluona)  that 
nave  an  "x"  in  eeoh  row 
designated  by  a  V* 

Criteria  for 
Select  ing 
Instructional 
Delivery 

Syataoa 

\ 

US)  we  VERBAL  INFORMATION 


Alternative  Instructional  Delivery  Syateus 


Oa livery  Approach*#  Dell fvy  Approach**  HOT 

Permitting  tha  Application  Permitting  Coaplaca 

of  ALL  Learning  Guidelines  Application  of  Learning 
and  Algorithm  Guidelines  end  n^titna 


Sc  leu lue  Criteria 

• 

visual 

United 

Pull 

• 

Visual 

Spactrua 

Pull  Color 

• 

audio 

voice  Sound 

Range 

Pull  Sound 

Range 

fntniflf  Setting  Criteria 

•  individual  Trainaaa  at  fixed  Location 

•  Individual  Trainaaa  with  Indapandant 
Inatruction  at  Any  Location 

•  Snail  Croup 

•  Large  group  at  a  Single  location 

•  Taan  Sat* ing 


Adaimatratlva  Criteria 

•  Sica  of  Couti«var«  and  Special  Mard- 


Local 

Control 
laltloo  Coot 
Lon 
nigh 


I 
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instructional  DELIVERY  system  chart  for  the  algorithm 

BUIE  ICANNIM  AND  USING 


|  Direction** 

To  choose  «  delivery 
lyltNli 

1.  Mace  a  %J*  Ulfht 

pencil)  la 

repreaantinp 
trove)  that  a«et  b* 

2.  Select  the  delivery 

•  yittai  IcoUani)  that 
have  **  -X*  1*  row 

deaipnatad  by  •  V 
Thaaa  ara  tha  candldata 
.delivery  efeteae. 


Criteria  for 
Selecting 
Instructional 
Oalivary 

Syitaaa  Y 


atiaaiu*  criteria 

•  Visual  for* 

pictorial.  Mans 

Lias  Construction.  M»»» 

Object.  toll* 

^  Invironaent 

•  Visual  noveaent 


oalivary  Approaches 
MrtlttlAf  tha  Applleatloo 
of  All  Learainp 


Oalivary  Approaahee  *0T 
faraittUf  Complete 
Applicatta*  of  tearainv 
Guidelines  aa4  Al*oritha 


•  visual  Spec*rue 
Gray  Scale 


voice  Sound  hanva 
Pull  sound  Sends 


■"actila  Cues 


internal  ttiaulua  nation 
Cues 

[sternal  Sciaulve  Motion 


■mill!!!!! 


Instructional  Setting  Criteria 

•  m.lvlJu.l  •«  rtMmt  loc.tl=" 

•  indl.Ua.l  Tr.ln.*  *»*»  I".*.""1*"1 
Instruction  at  Any  Location 

•  saail  Croup 

•  Larva  Croup  at  a  Sinyla  Location _ _ 


Adaimatraeiva  criteria 

•  Sit*  oi  Couraavara  and  Special  Hard- 
war#  Oevelopaant 
Local 
Central 

t«.«  .1  C«*' 


SS  nimaaanno 


S  SS«>*a|E*5SSS 

■■Mimiim 


■anuBM»»» 


*< 
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Table  B-2-4 

INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITM 


Directions; 

To  choose  e  delivery 

systee: 

1.  Place  a  V*  (light 
pencil)  in  boxes 
representing  criteria 
(rowsi  that  suit  be  sst. 

2.  Select  the  delivery 

have  an  "X"  in  each  row 
designated  by  a  *7*. 

These  are  the  candidate 
^delivery  systems. 

iiuiu  for 

electing 

nstructional 
e  1 1 very 

vs  tees 

\ 

MAKING  DECISIONS 


Alternatlvm  Instruct! 


Delivery  Approaches 
Permitting  the  Application 
of  All  Learning  Guidelines 
and  Algorithm 


Delivery  Approaches  NOT 
Permitting  Complete 
Application  of  (.earning 
Guidelines  and  A  Igor 1 1 ha 


St isulus  Criteria 

•  Visual  Tore 

Alphanumeric* 
Pictorial.  Plain 
Object ,  Solid 

•  Visual  Hovsstnt 

itili 

Full  Movement 

•  Audio 

Voice  Sound  Range 
Full  Sound  Range 

•  Other 

Tactile  Cues 


Training  Setting  Criteria 
•  individual  Trainae  ac  fixed  Location 


.ndeptndmt  Trainee  wun  Independent 
instruction  at  Any  Location 


•  Sea  1 1  Group 

•  Teas  setting 


Administrative  Criteria 


•  Site  of  courseware  and  Special  Hard¬ 
ware  Development 


itude  of  Acquisition  Cost 
Low 
Nigh 


■SSnii 

iiimi 


^  4 


Table  B-2-5 

INSTRUCTIONAL  OELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


DETECTING 


Criteria  tor 
Selecting 
Instructional 
Delivery 

Systems 

Directions i 

To  choose  a  delivery 
system: 

1.  Place  a  nJm  (light 

|  Alternative  Instructional  Delivery  Systems 

Dell 

Perm 

of  A 

and 

/ery  A 
Ltt ing 
LI  Lea 
ilgorl 

pproaches 
the  Application 
rn ing  Guidelines 
thm 

Del 

Per 

App 

Gui 

ivery  Approschss  NOT 
mitting  Complste 
licetion  of  Learning 
delines  and  Algorithm 

pencil)  in  boxes 
representing  crlteri 
(rows)  that  must  be 

2.  Select  the  delivi 
systems  (columns)  thi 
have  an  -X"  in  each 
designated  by  a  mJ*  . 
These  are  the  candidi 
^delivery  syeteas. 

oe  t  ■ 

iry 

t 

ow 

te 

e 

5  0 

■  O 

0 

«j  a 

IA  M 
♦J  M 

JZ  n  o 
**  C  0 

-  -  13 

*  u 

C  C 

■  «  e 
a  a 

O  T3 

•  C  W 

>  e  o 

IA  O 

•»  0 

-«  •  a 
e  -s  w 
c  e  a 

0  C  e 

—  O'  C 

W  -S  M 
«  IA 

W  A 

41  <0  U 

a.  « 
o  **  % 

Simulator  with  Instructor  and 
Instructor  Handbook 

A 

>. 

e 

a, 

(A 

O 

O 

o 

e 

3 

< 

£ 

■*4 

> 

w  u 
o  -* 
c 

e  o 

-  j 

3 

■  O 

«4  C 

ia  m 

w 

0 

-4  44 
*4  CJ 
-*  3 

a  w 

»  w 

w  « 
e  ►- 
c 

"4  C 

e  q 
*  e 

V  0 

a  o  o 

"0  3  0 

«  un 
(J  *  V 

0  te  a 

N  c  « 
a  -  a 

Procedure  Trainer  with  Adjunct 
Displays  and  Logic 

Operational  System  with 

I nst r uctor 

9> 

C 

C 

e 

h* 

t*  m 
« 

A  o 

0  U 
-i  >. 

1  V) 

e 

A  ~ 

**  m 
<  c 
e  o 
o 

w 
->  m 

e  w 
■  ii 

»*  a. 

3  o 

c  c 
«  0 

Stiaului  Criteria 

•  Full  Visual  Environment 

•  Full  Ambient  Sounds 

•  External  Stimulus  Motion  Cues 

X 

x 

X 

X 

X 

X 

X 

a 

m 

X 

X 

mm 

X 

Training  Setting  Cn 

•  Individual  Trainee 
(Schoo. ) 

•  Individual  Trainee 

ter  ia 

at  Fixed  Location 

D 

D 

D 

D 

fl 

B 

On-the-Job 

_ 

mm 

Z 

X 

X 

Administrative  Cnte 

•Site  of  Courseware 
ware  Development 

Loci  1 

Centra  1 

•  Magnitude  of  Acqui 

Low 

High 

r  ia 

and  Special  Hard- 

1 

■ 

1 

1 

■ 

1 

■ 

1 

■ 

■ 

Bi 

m 

D 

ZJ 

X 

EM 

EM 

KB 

D 

■itlon  Cost 

ZJ 

ZJ 

n 

ZJ 

X 

■i 

EH 

ai 

m 

Dl 

■31 

Bl 
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Table  B-2-6 

INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 

CLASSIFYING 


Directions : 

To  chooM  *  delivery 

•yse«R: 

1.  Plica  a  -7-  (light 
pencil)  in  boiaa 
ritpra<antin<7  criteria 
(row*)  chat  auit  be  eet 

2.  Sdact  tfi*  Jauvary 
system*  (coluans)  Chat 
tuva  in  -X-  in  aich  row 
d*S  iqnitad  by  *  "J"  ■ 
These  are  t h«  candidita 

^delivery  sysceea. 


Delivery  Approach** 
Parnttinq  the  Application 
of  All  Learning  Guideline* 
and  Algorithm 


Delivery  Approach**  not 
Permitting  Complete 
Application  of  Learning 
Guideline*  and  Algoncia 


Criteria  for 
Selecting 
instruct  ion* 1 
')« 1  ivery 
Sy  st tns 


Stimulus  Criteria 


•  visual  Fore 

A lphanueer  ic 
Pictorial.  ?l*ne 
Line  Construct  ion  .  Plan* 
Object.  Solid 
Envi  ronatnt 

•  Visual  Movement 


Voice  Sound  Rang* 

rail  Sound  Rlnqi 

Ambient  Sounds 

Other  Tactile  Cues 

Internal  stimulus  Motion  Cues 

External  Stimulus  Motion  Cues 


A.temi  s  c  r  a  c  ;  v*  Criceni 

•  jit*  u<  Courseware  and  Special  Hard* 
•  are  c«?ve.ofoent 


•  "luhltud*  Acquisition  Cost 


■%  f 
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Table  B-2-7 

INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


Directions  » 


IDENTIFYING  GRAPHIC  SYMBOLS 


Alternative  Instructions!  Delivery  Systems 


To  choose  s  delivery 

sys tea t 

1.  Plica  *  V  Uiqht 
pencil)  in  boxes 
representing  criteria 
(rows)  that  aust  be  aet 

2.  Select  the  delivery 
systeas  (coluans)  that 
have  an  "X"  in  each  row 
designated  by  a  %/“ . 
These  are  the  candidate 
delivery  systeas. 


Delivery  Approaches 
Permitting  the  Application 
of  All  Learning  Guidelines 
snd  Algorithm 


Delivery  Approaches  NOT 
Permitting  Complete 
Application  of  earning 
Guidelines  and  Algorithm 


Criteria  for 
Ss lact ing 
Instructional 
Dal  i very 

Systems 


Training  Setting  Criteria 

• 

Individual  Trainee 

at  a 

Fixed  Location 

• 

Individual  Trainee 

with 

Independant 

Instruction  at  Any 

Location 

Administrative  Criteria 

•  Site  of  Courseware  and  Special  Hard¬ 
ware  Development 

Local 

Central 

•  Magnitude  of  Acquisition  Cost 

Low 

High 
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Table  B-2-8 

INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


VOICE  COMMUNICATING 


tructionil  Delivery  Systems 


To  choou  a  d«liv«ry 
tyicaa : 

1.  Place  A  mJm 

pencil)  in  boi«« 


(rows)  that  auit  be  met. 

2.  jaltet  the  delivery 
system*  (columns)  th«c 
haw  an  “X"  in  each  cow 
designated  by  *  nJm  . 
These  are  the  candidate 
l delivery  systems. 


Delivery  Approaches 
Permitting  the  Application 
of  All  Learning  Guidelines 
and  Algorithm 


Delivery  Approaches  XOT 
Permitting  Complete 
Application  of  Lfirmr.q 
Guidelines  and  Algorithm 


Stimulus  Criteria 

•  Visual  Form 

Pictorial.  Plane 
Solid  Object 

•  Visual  Movement 

Still 

Full  Movement 

•  A ud  i  o 

Voice  Sound  Range 
Ambient  Sounds 


setting  Criteria 

idue  1  Tr a i nee 

at  a 

P  txed  Locat ion 

iJujI  Trainee 

with 

1 ndependen  t 

ic  c ion  at  Any 

Loca  1 1 on 

Setting 

Administrative  Cntat  u 

•  Site  of  Courseware  and 
Spacial  Hardware  Development 

Local 

Central 

•  Magnitude  of  Acquisition  Cost 

Lo- 
H  igh 


B-2-8 
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Table  B-2-9 

INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


HRAUING  PROCEOUfteS  AMO  MOSmOMING  MOVEMENT 
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Table  B-2-10 

INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  TIC  ALGORITHM 

STEERING  ft  GUIDING -CONTINUOUS  MOVEMENT 


Directions  : 

To  choose  a  delivery 
aye  tea  t 

1 .  Place  a  *J "  (light 
pencil)  in  boxes 
representing  criteria 
(rows)  that  oust  be  met 

2.  Select  the  delivery 

systems  (columns)  that 
have  an  "X"  in  each  row 
designated  by  a  . 

These  are  the  candidate 
lelivery  systems. 


alternative  Instructional  Delivery  systems 


Delivery  Approaches 
Permitting  the  Application 
of  All  Learning  Guidelines 
and  Algorithm 


Delivery  Approaches  NOT 
Permitting  Complete 
Application  of  Laarning 
Guidelines  and  Algorithm 


Cri ter  1a  for 
Selecting 
Instructional 
Oe livery 
Systems 


Stimulus  Criteria 


Full  Visual  Environment 


External  Stimulus  Motion  Cues 


Fine  Movement  Manipulative  Acts 


Broad  Movement  Manipulative  Acts 


Training  Setting  Criteria 

Inaividual  or  Team  Training 
at  a  Fixed  Location 


Individual  or  Team  Training 
with  independent  Instruction 


at  Many 

Locations 

Admin i a t rat i ve 

Criteria 

Site  a  f 

Courseware  and 

Spec ia 1 

Hardware  Development 

Loci  J 

:entrn 
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Table  B-2-11 

INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


Directions 


PERFORMING  GROSS  MOTOR  SKILLS 


Alternative  Instructional  Delivery  Systems 


To  chooaa  a  dalivary 

ay  a  tan : 

1.  Plica  a  V  (light 
pencil)  in  boxes 
representing  crltarit 
(rows)  that  Must  ba  sat. 

2,  Salact  tha  dalivary 
ayataaa  (coluana)  that 
hava  an  " X"  in  aach  row 
designated  by  a  mJm. 
Thaaa  ara  tha  candidata 
dalivary  systems. 


Dalivary  Approaches 
Permitting  tha  Application 
of  All  Laarniag  Guidalinaa 
and  Algoritha 


Dalivary  Approachaa  NOT 
Paraitting  Coaplata 
Application  of  Learning 
Guidalinaa  and  Algoritha 


Criteria  for 
Selecting 
instructional 
Dalivary 

Systems 


•  <r  m  m 
m  a  o  a 
u  0  h 


A  **  O 
o  c  w  c 
n  a  o  o* 


Training  Setting  Criteria 

• 

Individual  Trainee 

fixed  Location 

at  a 

• 

Individual  Trainee 

with 

Independent  Instruction 

at  Many  Locations 

• 

Small  Group 

• 

Team  setting 

Administrative 

Criteria 

•  Site  of 

Courseware  Development 

Loca  1 

Central 
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Table  B-2-12 


INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


This  chart  is  aeaful  is  selecting  aa  inatruc t ions 1 
delivery  aystea  (or  ths  affective  sad  behavioral 
coaponenta  of  attitude  learning.  ror  achieving  the 
cognition  coaponent  use  instructional  delivery 
syeteas  suggested  for  recalling  bodies  of  knowledge 


ATTITUDE  LEARNING 


1 


ANNEX  C 
ATM 


! 

1 


ANNEX  C 
APPENDIX  1 


TASK  VERB  LIST 


Verb 

Definition1 

Category^ 

Accomplish 

Complete 

General 

Accumulate 

a  -  Collect  (a) 
b  -  Add 

15 

1 

Achieve 

Complete 

General 

Acknowledge 

a  -  Answer  (a)J 
b  -  Answer  (b) 

7,8,9 

4 

Acquaint 

Inform 

7,8 

Acquire 

a  -  Detect,  identify  and  locate  a  target  in 
sufficient  detail  to  permit  the  effective 
employment  of  weapons.# 
b  -  Position  tracking  apparatus  of  a  weapon 
system  so  that  a  designated  target  is 
tracked.# 

4,12 

12 

Activate 

Give  power  to  equipment  so  that  it  may 
begin  tc  operate! 

10 

Adapt 

Modify  to  fit  a  new  use 

3 

Add 

Perform  the  mathematical  operation  of 
combining  nunbers  into  a  sum 

1 

1  All  definitions  have  been  checked  against  Webster’s  New  World  Dictionary. 
Second  College  Edition,  Cleveland,  Ohio:  William  Collins  +  World  Publishing 
Co.,  Inc.,  1976.  Those  definitions  designated  by  a  section  mark  (§)  are  not 
found  in  this  dictionary  but,  in  Litton' s  opinion,  are  used  with  sufficient 
frequency  to  warrant  inclusion  in  the  list.  Definitions  designated  by  #  are 
from  AR  310-25,  Dictionary  of  U.  S.  Array  Terms. 

2 

The  definition  of  categories  1-15  are  given  in  Appendix  C  along  with  the 
synonym  relationships  among  the  words  in  each  category;  the  synonym  relation¬ 
ships  among  words  in  the  "General"  category  are  given  in  Appendix  A. 

^Many  action  verbs  indicate  the  process  of  information  transfer  without 
reference  to  the  means  of  transfer.  These  verbs  are  appropriate  both  to 
categories  7  and  8.  These  verbs  may  also  be  appropriate  to  category  9 
although  signaling  is  not  usually  appropriate  to  the  conrcunication  of  large 
quantities  of  information  or  fine  detail.  To  classify  a  particular  task  when 
these  verbs  are  used,  you  must  also  determine  the  conmunication  process. 


Verb 

Adjust 

Advise 

Alert 

Align 

Alter 

Answer 

Apply 

Appraise 

Apprise 

Ascertain 

Ask 

Assemble 

Assure 

Attach 

Attack 


Definition 


Category 


a  -  Manipulate  controls,  levers,  linkages  and 
other  equipment  items  to  return  equipment 
from  an  out-of-tolerance  condition  to  an 


in-tolerance  condition  1 1 

b  -  Adapt  (usually  used  with  to)  3 

Inform  7,8 

Inform  designated  persons  that  a  certain 

condition  exists  in  order  to  bring  them 

up  to  a  watchful  state  in  which  a  quick 

reaction  is  possible  7,8,9 


Adjust  controls  to  match  visual  indicators, 
such  as  pointers,  lines  of  sight,  wave 
forms,  or  aural  signals,  until  coincidence 


is  achieved  1 1 

Modify  the  method  of  operation  or  some 

component  of  a  unit  of  equipment  General 

a  -  Reply  in  words  to  a  question  7,8,9 

b  -  React  in  response  to  an  anticipated 
visual,  auditory  or  other  non-verbal 
stimulus  4 

a  -  Spread  a  substance  on  a  surface  15 

b  -  Use  General 

a  -  Evaluate  (a)  1 

b  -  Evaluate  (b)  1 

Inform  7,8 

Obtain  exact,  first-hand  knowledge  of 
a  condition  3 

Seek  information  from  a  person  verbally  7,8,9 

Perform  the  various  manual  operations 


necessary  to  place,  align,  fit,  or  secure 
together  two  or  more  components  to  complete 


a  larger,  more  complex  piece  of  equipment  11 

Ensure  General 

Connect  one  object  to  another;  in  general, 

it  will  be  a  smaller  object  onto  a  larger 

object  11 

Engage  (c)  10 


01-2 


Verb 

Definition 

Category 

Attempt 

Make  an  effort  to  accomplish  a  task  or 
goal,  but  with  the  realization  that  failure 
is  a  possibility 

General 

Begin 

Set  in  motion  some  action  or  process  by 
taking  the  first  step 

General 

Brief 

Inform 

7,8 

Calculate 

Compute 

1 

Calibrate 

Determine  and  correct  the  accuracy  of  a 
piece  of  equipment  by  special  measurement 
or  by  comparison  with  a  standard 

10 

Call 

a  -  Shout  or  announce 
b  -  Communicate  with  by  electromagnetic 

7 

means  (e.g.,  telephone,  radio) 

7 

Carry 

Move  a  load  while  supporting  it 

15 

Cease 

Stop  (a) 

General 

Change 

a  -  Alter 

General 

b  -  Remove/Replace 

11 

Check 

a  -  Hold  back  or  restrain 
b  -  Verify  the  result  of  an  action,  the 

13 

existence  of  a  condition,  or  the 
accuracy  of  measurements 

3 

c  -  Mark  with  a  check 

15 

Check  out 

Inspect  for  satisfactory  condition, 
accuracy,  safety,  or  performance 

3 

Choose 

Select 

2 

Cipher 

Code 

1 

4 

Classify 

Assign  objects,  symbols,  ideas,  etc.  to 
categories  based  on  their  characteristics 

5,6 

Clean 

Remove  dirt,  impurities,  or  extraneous 
matters 

10 

Cleanse 

Clean 

10 

- - 

Many  action  verbs  indicating  the  process  of  classifying  are  independent  of 
the  object  classified.  These  verbs  are  appropriate  both  the  categories  5  and 
6.  To  classify  a  particular  task  when  these  verbs  are  used,  you  must  also 
determine  the  nature  of  the  classified  object. 


C-1-3 


Verb 


Definition 


Close 

a  -  Move  something  so  as  to  block  passage 
through  an  opening  or  to  and  from  an 
enclosure 

b  -  Complete  an  electrical  circuit! 

11 

11 

Code 

Convert  a  message,  document,  etc.,  from 
ordinary  language  to  a  coded  system  of 
letters,  words,  numbers,  or  symbols 

1 

Collate 

a  -  Compare 
b  -  Gather  in  order 

5,6 

6 

Collect 

a  -  Gather  together  (stress  on  physical  act 
of  gathering) 

b  -  Classify  (stress  on  identifying  objects 
to  be  gathered) 

15 

5,6 

Command 

Specify  verbally  a  course  of  action  to 
be  taken  by  others 

7 

Coianunicate 

a  -  Broadcast  messages,  signals,  signs, 
writing,  images,  or  sounds  by  wi-’e, 
radio,  visual,  or  other  electro¬ 
magnetic  means  (stress  on  operating 
the  communications  equipment) 
b  -  Transmit  information  (stress  on  the 
message  transmitted) 

10 

7,8,9 

Compare 

Examine  the  characteristics  of  two  or  more 
items  to  determine  their  similarities  and 
differences 

5,6 

Complete 

End  successfully  an  entire  task,  opera¬ 
tion,  or  mission,  or  part  thereof 

General 

Compute 

Determine  the  value  by  mathematical  means 

1 

Conduct 

Manage  (a) 

2 

Confirm 

Verify 

3 

Conform 

Adapt 

3 

Connect 

Couple,  fasten,  or  join  pieces  of  equipment 

11 

Continue 

a  -  Go  on  with  a  course,  direction  or 
action  already  in  progress 
b  -  Resume  an  action  after  stopping 

General 

General 

Contrast 


Compare  to  identify  differences 


5,6 


Verb 


Definition 


Control 

Convey 

Coordinate 

Count 

Deactivate 

Decide 

Decipher 

Decode 

Decrease 

Delay 

Demand 

Depress 

Detain 

Detect 

Determine 

Direct 


Category 


a  -  Manipulate  repetitively  discrete-action 
switches,  linkages  and  controls  to  maintain 


equipment  in  an  in- tolerance  condition  12 

b  -  Steer  13 

a  -  Transport  15 

b  -  Give  a  message  to  7,8 

Adjust  the  actions  of  various  people  or 

pieces  of  equipment  so  that  their  combined 

action  is  in  harmony  2 

Add  up,  one  by  one,  the  total  number  of 

units  in  a  collection  1 

Remove  the  power  so  that  equipment  ceases 

operation  10 

a  -  Choose  a  course  of  action  2 

b  -  Make  a  judgment  2 

Decode  1 

Convert  a  coded  message,  document,  etc. 

into  ordinary  language  1 

Lessen  in  amount  General 

Stop  or  hinder  for  a  short  time  General 

Require  2 

Push  down,  especially  manually  '5 

Delay  General 

Become  aware  of  the  existence,  presence,  or 

fact  of  a  particular  condition  4 

a  -  Ascertain  3 

b  -  Decide  2 

a  -  Steer  13 

b  -  Conmand  7 


Disable 


Remove  from  a  state  of  readiness  so  as  to 
prevent  action§ 


10 


Verb 


Definition 


Disassemble 

Discard 

Discharge 

Disconnect 

Discontinue 

Discover 

Disengage 

Disjoin 

Divide 

Draft 

Drag 

Employ 

Empty 

Enable 

Encode 


Category 


Perform  the  various  manual  operations 

necessary  to  take  apart  a  piece  of 

equipment  to  the  next  lower  level  of  sub- 

assemblies  or  to  the  level  of  component 

parts  11 

Throw  away  or  get  rid  of  equipment  or 

components  which  are  no  longer  functional 

or  useful  2 

a  -  Unload  or  empty  15 

b  -  Fire  10 

c  -  Perform  an  obligation  General 

d  -  Remove  stored  energy  from  a  battery 

or  capacitor  10 

Separate  or  undo  the  connection  between 

pieces  of  equipment  11 

Stop  (a)  General 

Ascertain  3 

a  -  Disconnect  or  loosen  a  fastening  so 

that  it  no  longer  restricts  movement  11 

b  -  Disconnect  or  loosen  a  power  transfer 
device  so  that  power  is  no  longer 
transferred  10 

Disconnect  1 1 

a  -  Separate  11 

b  -  Classify  5,6 

c  -  Perform  the  mathematical  operation 
of  finding  how  many  times  one  number 
contains  another  number  1 

Draw  the  preliminary  sketch,  version  cr 

plan  of  an  object  14 

Pull  (a)  15 

Use  General 

Pour  out  or  remove  the  contents  of  a 

container  15 

Bring  to  a  state  of  readiness?  10 

Code  1 


C-1-6 


Verb 


Definition 


Endeavor 

Attempt 

General 

Engage 

a  -  Connect  or  lock  a  fastening  so  that 

movement  is  restricted 

b  -  Connect  or  fasten  a  power  transfer  device 

11 

so  that  power  is  transferred 

10 

c  -  Attack  designated  contact 

10 

Ensure 

Make  certain;  guarantee  the  existence 

of  a  condition 

General 

Enter 

Inputs 

8 

Enumerate 

a  -  Count 

1 

b  -  List 

1 

Establish 

Set  up  or  institute  initially 

General 

Estimate 

Evaluate  (a) 

1 

Evaluate 

a  -  Determine  the  numerical  amount  or 

monetary  value  of  equipment 
b  -  Judge  the  condition  or  worth  in  non¬ 
monetary  terms  of  a  piece  of  equipment 

1 

or  procedure 

1 

Examine 

a  -  Interrogate  (a) 

7 

b  -  Inspect 

4 

Execute 

Carry  out ,  especially  orders  or  plans 

General 

Extend 

Reach  out  or  draw  out  to  or  from  a 

given  point 

11 

Fasten 

a  -  Attach 

11 

b  -  Lock  (a) 

10 

Fill 

Pour  or  put  into  a  container,  especially 
an  amount  which  occupies  the  entire 

volume 

15 

Finish 

a  -  Complete 

General 

b  -  Give  a  desired  effect  to  a  surface 

14 

Fire 

Cause  a  weapon  to  emit  a  projectile 

10 

Fly 

Operate  a  manned  or  unmanned  aircraft  or 
spacecraft  through  the  air  or  space, 

especially  after  it  has  left  the  ground 

13 

Follow 


Go  after,  either  in  order  or  time 


General 


Verb 


Definition 


Furnish 

Guide 

Halt 

Handle 

Identify 

Illuminate 

Increase 

Inform 

Initiate 

Input 

Insert 

Inspect 

Install 

Instruct 

Insure 

Interrogate 

Introduce 

Isolate 

Iterate 


Provide  General 

Steer  13 

Stop  (a)  General 

a  -  Control  (a)  12 

b  -  Manage  (a)  2 

c  -  Steer  13 

Recognize  or  determine  the  exact  nature 

of  something  5,6 

Give  light  to  an  area  or  display  surface  10 

Add  to  or  augment  General 

Give  knowledge  of  something  to  one  or 

more  persons  7,8 

Bring  into  practice  or  action  by  first 

doing  or  using  General 

Insert  commands  and/or  data  into  a  machine 
by  electromechanical  means  (e.g.,  keyboard)§  8” 

* 

Put  or  fit  something  into  something  else  Ti 

Look  at  carefully,  especially  in  order 

to  detect  flaws  or  errors  4 


Attach  or  mount  in  position  for  use 


11 


Communicate  knowledge  in  a  learning  setting 

* 

Ensure 


7 

General 


a  -  Ask  questions  of  in  a  systematic 

manner  7 

b  -  Signal  a  device  or  computer  so  as  to 
receive  information  regarding  the 
status  or  condition  of  its  components§  8 


a  -  Insert 
b  -  Initiate 


11 

General 


a  -  Find  or  identify,  especially  the  cause 

of  an  equipment  malfunction!  3 

b  -  Set  apart  from  other  objects  or  people  11 


Repeat ,  especially  3  process 


General 


C-1-8 


Verb 

Definition 

Category 

Judge 

a  -  Evaluate  (a) 

1 

b  -  Evaluate  (b) 

1 

c  -  Decide 

2 

Junk 

Discard 

2 

Land 

Set  a  manned  or  unmanned  aircraft  down  on 
a  surface  (e.g.,  land,  water)  and  bring  it 
to  a  stop  (excludes  taxiing) 

13 

Launch 

a  -  Begin  the  flight  of  a  missile  or  rocket 
b  -  Send  forth  with  some  added  force  (e.g., 

10 

launch  an  aircraft  by  catapult) 

10 

Lay 

Adjust  a  gun  to  proper  direction  and  elevation 

11 

Light 

Illuminate 

10 

Line 

Align 

11 

List 

Make  a  list  or  category  of  people,  objects, 
ideas,  etc. 

1 

Listen  for 

Be  alert  to  catch  an  unexpected  sound 

Load 

a  -  Inputs 

b 

b  -  Fill 

15 

c  -  Put  ammunition  in  a  weapon 
d  -  Place  an  electrical  load  on  a  battery 

11 

or  generators 

11 

Locate 

a  -  Isolate  (a) 

3 

b  -  Find  a  location  as  on  a  map 

5 

Lock 

a  -  Fasten  shut  by  means  of  a  lock 
b  -  Jam  or  force  together  so  as  to  be 

10 

immovable  (e.g.,  lock  brakes) 

10 

c  -  Put  or  fasten  in  a  fixed  position 

11 

Log 

Record  (a) 

8 

Loosen 

Lessen  the  force  applied  by  a  binding  or 
fastening,  especially  so  as  to  permit 

15 

movement 

Lower 

Move  an  object  in  a  downward  direction, 
attitude,  or  angle 

11 

Maintain  a  -  Keep  at  the  same  level  or  position  13 

b  -  Keep  in  operating  condition  or  good 
repair 


General 


Verb 


Definition 


Manage 

a  -  Have  control  over 

2 

b  -  Control  (a) 

12 

c  -  Steer 

13 

Mate 

Connect 

11 

Mend 

Repair 

10 

Monitor 

a  -  Watch  or  check  on  the  performance  or 

oondition  of  equipment 
b  -  Watch  or  listen  to  the  output  of  de¬ 

U 

tection  devices  (e.g.,  radar  screen) 
c  -  Watch  or  listen  to  the  transmission  of 

information 

7,0,9 

Multiply 

Perform  the  mathematical  operation  of  add¬ 
ing  a  number  to  itself  a  specified  nunber 

of  times 

1 

Note 

a  -  Record  (a) 

a 

b  -  Observe  (b) 

General 

c  -  Observe  (c) 

4 

Notify 

Inform 

7,0 

Numerate 

Count 

1 

Observe 

a  -  Adhere  to,  follow,  or  abide  by  a  set 

of  rules 

1 

b  -  Pay  special  attention  to 

General 

c  -  Look  at 

4 

Obtain 

Get  possession  of  or  procure,  especially 

by  some  effort 

General 

Open 

a  -  Move  something  so  as  to  permit  passage 
through  an  opening  or  access  to  an 

11 

enclosure 

b  -  Break  an  electrical  circuits 

11 

Operate 

Put  or  keep  a  piece  of  equipment  in  pur¬ 

poseful  action 

General 

Order 

a  -  Arrange  in  sequence 

b 

b  -  Command 

7 

c  -  Requisition 

0 

Overhaul  Check  thoroughly  for  needed  repairs  and 

to  make  those  repairs  and  adjustments  so 
as  to  restore  equipment  to  good  working 
order 


10 


Verb 


Definition 


Category 


Package 

Park 

Pass 

Perform 

Place 

Play 

Plug 


Position 

Prepare 

Present 

Press 

Probe 

Provide 

Pull 


Push 

Query 


Wrap  or  box,  as  for  transporting  or 

carrying  10 

Maneuver  a  vehicle  into  a  space  where  it 

can  be  left  temporarily  13 

Cause  or  allow  an  object  to  go  through  or 

around  another  (e.g. ,  pass  the  rope  through 

the  eyelet,  pass  a  vehicle  on  the  road)  13 

Act  on  or  do  so  as  to  bring  to  completion  General 

Put  an  object  in  a  particular  place,  con¬ 
dition,  or  relation  to  other  objects  11 

Cause  a  video  or  audio  recording  to  give 

out  images  and/or  sounds  through  the 

operation  of  a  playback  device  10 

a  -  Stop  up  or  fill  a  hole  or  gap  by  in¬ 
serting  a  plug  11 

b  -  To  connect  an  electrical  device  with 
a  power  source  by  inserting  the  power 
cord  in  a  socket  or  jack  (usually 
used  with  in)  11 

Place  1 1 

Make  ready,  usually  for  a  specific  purpose  General 

Exhibit  or  display  an  image  or  message  on 
a  screen  10 

Depress  15 

a  -  Interrogate  (a)  7 

b  -  Explore  manually  with  a  probe  4 

Make  available  material  or  services  General 

a  -  Exert  force  on  an  object  so  as  to 
cause  the  object  to  move  toward  or  in 
the  same  direction  as  the  source  of 
the  force  15 

b  -  Extract  15 

Exert  force  against  so  as  to  move  an 

object  away  from  the  source  of  the  force  '  15 

Ask  7 ,b  ,9 


C-l-ll 


Verb 


Definition 


Category 


Question 

Raise 

Reach 

Read 

Receive 

Record 

Recognize 

Regulate 

Reiterate 

Release 

Remove 

Repair 

Repeat 


Interrogate  (a) 

Move  an  object  in  an  upward  direction, 
attitude,  or  angle 


a  -  Extend  to  or  touch  by  thrusting  out 
b  -  Penetrate  to 

a  -  Get  the  meaning  of  something  written 
by  using  the  eyes 

b  -  Observe  and  record  values  indicated 
by  visual  displays  or  gauges 

Get  visual  or  auditory  messages  or  signals 
by  electromagnetic  means  (e.g.,  radio, 
telephone) 

a  -  Put  in  writing  for  future  use 
b  -  Register  sound  or  visual  images  in 
some  permanent  form,  such  as  phono¬ 
graph  disc,  magnetic  tape,  etc.,  for 
reproduction  on  a  playback  device 

Perceive  to  be  something  previously  known 

a  -  Control  (a) 
b  -  Steer 

Repeat,  especially  a  spoken  message  or 
order  for  emphasis 

a  -  Let  go  or  let  loose  from  the  manual 
application  of  pressure 
b  -  Set  free  from  a  restrictive  force 
(e.g.,  release  the  brake) 

a  -  Lift,  push,  transfer,  or  carry  some¬ 
thing  away  from  its  current  location 
to  another 

b  -  Take  an  object  off  of  another 

Replace  or  restore  damaged,  worn  out,  or 
malfunctioning  components  so  that  the 
equipment  is  serviceable,  usable,  or  in 
operating  condition. 

a  -  Say  again 

b  -  Do  or  make  a  task,  test,  or  operation 
an  additional  time;  do  over  again 


7 

11 

11 

11 

6 

6 

10 

a 

10 

5,6 

12 

13 

7 

15 

10 

11 

11 

10 

7 

General 


Verb 


Definition 


m 


Replace 

a  -  Put  something  back  in  the  proper  place 

or  position 

b  -  Provide  a  substitute  or  equivalent  for 

11 

equipment  or  components  of  equipment 

11 

Reply 

Respond 

7, a, 9 

Report 

a  -  Give  an  account  of  something  seen  or 

done,  often  at  regular  intervals 
b  -  Make  known  the  presence,  approach ,  or 

7, a 

occurrence  of  something  or  someone 

7,9 

Request 

Ask  for  something  or  some  action 

7, a, 9 

Require 

Ask  or  insist  upon  by  right  of  authority 

2 

Requisition 

Submit  a  written  order  or  request  for 

something 

a 

Respond 

Say  in  answer 

7 

Restore 

Repair 

10 

Resume 

Begin  again  or  go  on  with  again  after 

interruption 

General 

Retract 

Draw  back  or  draw  in  some  item  of  equipment 

11 

Return 

Replace  (a) 

11 

Reveal 

Present 

10 

Review 

Examine  work  performed  or  documents  pro¬ 
duced  to  determine  adequacy,  correctness, 

preciseness,  etc. 

2 

Revise 

Read  over  carefully  and  correct,  improve, 
or  update  a  document,  procedure,  or 

regulation 

3 

Rotate 

a  -  Turn  around  or  cause  to  turn  around 
a  center  point  or  axis  in  either 

direction 

b  -  Take  or  cause  to  take  turns  in  regular 

15 

succession  (e.g.,  rotate  the  tires) 

11 

Scrap 

Discard 

2 

Scrutinize 


Inspect 


4 


Verb 

Definition 

Seal 

a  -  Close  so  as  to  prevent  non-destructive 
opening  of  a  container  or  enclosure 
b  -  Close  completely  so  as  to  make  airtight 
or  watertight 

c  -  Apply  a  non-permeable  coating  to  a 
porous  surface,  as  before  painting 

Secure 

a  -  Make  firm,  fast  or  tight 
b  -  Put  under  restraint;  tie  up 

Seize 

Take  hold  of  forcibly  with  the  hand; 
clutch 

Select 

Pick  out  from  among  alternatives 

Send 

Transmit 

Separate 

Place  the  parts  of  an  object  in  physically 
separate  locations 

Service 

Make  or  keep  fit  for  service  as  by  in¬ 
specting,  adjusting,  repairing,  re¬ 
fueling,  etc. 

Set 

Adjust  a  measuring  device  to  a  desired 
position  or  to  be  in  oonformity  with  a 
standard 

Set  up 

Arrange  a  piece  of  equipment  and  necessary 
servicing  tools  preparatory  to  checking 
out  or  servicing  that  piece  of  equipments 

Sew 

Unite  or  fasten  by  stiches  made  with 
flexible  thread  or  filament 

Sharpen 

Make  sharp  or  sharper  a  cutting  edge  or 
piercing  point 

Shove 

Push 

Shut 

a  -  Close  (a) 

b  -  Fold  up  or  bring  together  the  parts 
of  a  device 

Signal 

Communicate  by  sight  (e.g.,  flags,  flashing 
lights,  hand  signs)  or  sound  (e.g.,  Morse 
code ,  tones)  other  than  written  or  spoken 
language 

Splice 

Unite  by  interviewing  strands  or  lapping 
two  ends 

Category 

10 

10 

10 

11 

11 

15 

2 

10 

11 

10 

11 

11 

14 

14 

15 
11 
11 

9 

14 


C-l-14 


Verb 

Definition 

Category 

Start 

a  -  Begin 

General 

b  -  Set  in  motion,  action,  or  operation 

10 

Stay 

a  -  Delay 

General 

b  -  Stop  (a) 

General 

Steer 

Manipulate  the  continuous-action  controls  of 
a  vehicle  (e.g.,  steering  wheel)  so  as  to 
determine  its  course  or  movement 

13 

Stop 

a  -  Interrupt  or  end  the  motion  or  opera¬ 

tion  of  equipment  or  the  progress  of 
a  process 

General 

b  -  Plug  (a) 

11 

Store 

a  -  Put  aside  for  use  when  needed 

11 

b  -  Put  in  a  warehouse  for  safekeeping 
c  -  Placing  or  keeping  information  in  a 

11 

oomputer  memory 

10 

Stretch 

Extend 

11 

Strive 

Attempt 

General 

Succeed 

Follow 

General 

Supply 

Provide 

General 

Survey 

View  comprehensively 

4 

Switch 

Change  (b) 

11 

Subtract 

Perform  the  mathematical  operation  of 
deducting  or  removing  one  number  from 
another 

1 

Take 

a  -  Get  possession  of  by  force;  grasp 
b  -  Obtain  possession  of  or  assume  control 

15 

of  equipment,  not  by  force  or  skill 
(e.g.,  take  control  of  an  aircraft) 

2 

Take  off 

Cause  an  aircraft  to  leave  the  surface 
(e.g.,  ground,  water)  in  flight 

13 

Taxi 

Cause  an  aircraft  to  move  slowly  along 
the  surface  (e.g.,  ground,  water)  under 
its  own  power  as  before  taking  off  or 
after  landing 

13 

Teach 

Instruct 

7 

C-l-15 


Verb 


Definition 


Category 


Test 

a  -  Operate  equipment  on  a  temporary  basis 
to  determine  if  it  is  functioning 
properly 

b  -  Operate  equipment  to  determine  the 
limits  of  its  performance 

Throw 

a  -  Cause  to  fly  through  the  air  by  re¬ 
leasing  from  the  hand  while  the  arm 
is  in  rapid  motion;  hurl 
b  -  Move  a  lever,  clutch,  or  switch  or 
connect,  disconnect,  or  engage  a 
power  source  by  such  movement 

Tighten 

Increase  the  force  applied  by  a  binding 
or  fastening,  especially  so  as  to  restrict 
movement 

Track 

a  -  Keep  a  gun  properly  aimed,  or  to  point 
continuously  a  target  locating  instru¬ 
ment  at  a  moving  target .# 
b  -  Lock  onto  a  point  of  radiation  and  obtain 
guidance  therefrom.# 

Transfer 

a  -  Convey,  carry,  or  send  an  object  from 
one  place  to  another 
b  -  Give  to  another  person,  especially 
authority  or  control 

Transmit 

Send  out  a  message  by  means  of  electro¬ 
magnetic  radiation 

Transport 

Carry  from  one  place  to  another,  especially 
over  long  distances 

Troubleshoot 

Locate  and  eliminate  the  source  of  trouble 
in  any  flow  of  work  or  operating  system 

Try 

Attempt 

Tug 

Pull  at  with  great  force 

Tune 

Adjust  equipment  to  the  proper  or  desired 
performance  level 

Turn 

Rotate  (a) 

Type 

Print  or  display  alphanumeric  characters  or 
symbols  by  pressing  keys  on  a  keyboard 

Update 

Make  conform  to  the  most  recent  facts, 
methods,  ideas,  etc. 
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10 

10 

15 

11 

15 

13 

13 

15 

2 

10 

15 

3 

General 

15 

10 

15 

3 


3 


Verb 


Definition 


Use 

Put  or  bring  a  plan  or  piece  of  equipment 
into  action  or  service  so  as  to  accomplish 
an  end 

General 

Utilize 

Use 

General 

Vary 

Change  (a) 

General 

Verify 

Substantiate  the  correctness  of  something 
by  demonstration,  evidence,  or  testimony 

3 

Wait 

Stay  or  remain  in  a  state  of  readiness  in 
anticipation  of  something;  await 

General 

Watch 

Observe  (c) 

4 

Weld 

Unite  metallic  parts  by  heating  ana  allowing 
the  metals  to  flow  together 

m 

Wield 

Handle  (a),  especially  with  skill 

12 

C— 1—17 


ANNEX  C 


APPENDIX  2 

CATEGORY / SYNONYM  LIST 


1 .  Selecting  and  applying  rules 

Tasks  in  this  category  have  as  their  central  behavior  deciding  which  rule 
is  appropriate  to  the  goal  and/or  applying  the  appropriate  rule  properly.  Rules 
specify  how  quantities,  objects,  or  situations  are  transformed  into  other  quan¬ 
tities,  objects,  or  situations.  The  rule  may  be  general  (e.g.,  rule  for  multi¬ 
plying  two  numbers)  or  it  may  be  a  list  of  possibilities,  that  is,  a  series  of 
"If  ...  then"  statements  A  rule  (as  opposed  to  a  procedure)  is  never  limited 
to  a  single  possibility.  The  correct  choice  and  application  of  the  rule  will 
always  lead  to  accomplishment  of  the  goal. 


Verb 

Synonyms 

Accumulate  (b) 

Add 

Add 

Accumulate  (b) 

Appraise  (a) 

Estimate;  Evaluate  (a);  Judge  (a) 
Evaluate  (b);  Judge  (b) 

Appraise  (b) 

Calculate 

Compute 

Cipher 

Code;  Encode 

Cipher;  Encode 

Code 

Compute 

Calculate 

Count 

Enumerate  (a);  Numerate 

Decipher 

Decode 

Decode 

Divide  (c) 

Decipher 

Encode 

Cipher;  Code 

Enumerate  (a) 

Count;  Numerate 

Enumerate  (b) 

List 

Estimate 

Appraise  (a);  Evaluate  (a);  Judge 

Evaluate  (a) 

Appraise  (a);  Estimate;  Judge  (a) 
Appraise  (b);  Judge  (b) 

Evaluate  (b) 

Judge  (a) 

Appraise  (a);  Estimate;  Evaluate 
Appraise  (b);  Evaluate  (b) 

Judge  (b) 

List 

Multiply 

Enumerate  (b) 

Numerate 

Observe  (a) 

Subtract 

Count;  Enumerate  (a) 

2 .  Making  decisions 


Tasks  in  this  category  have  as  their  central  behavior  choosing  a  course  of 
action  when  the  best  available  alternative  may  not  be  successful.  The  relative 
value  of  success  and  cost  of  failure  for  each  alternative  must  be  considered. 
Often  the  range  of  possible  alternatives  is  wide  and  unspecified  and  the  choice 
must  be  made  rapidly,  without  exhaustive  consideration  of  alternatives. 


Verb 

Synonyms 

Choose 

Decide  (a);  Determine  (b);  Select 

Conduct 

Handle  (b);  Manage  (a) 

Coordinate 

Decide  (a) 

Choose;  Determine  (b);  Select 

Decide  (b) 

Judge  Cc) 

Demand 

Require 

Determine  (b) 

Choose;  Decide  (a);  Select 

Discard 

Junk;  Scrap 

Handle  (b) 

Conduct;  Manage  (a) 

Judge  (c) 

Decide  Cb) 

Junk 

Discard;  Scrap 

Manage  (a) 

Conduct;  Handle  (b) 

Require 

Demand 

Review 

Scrap 

Discard;  Junk 

Select 

Choose;  Decide  (a);  Determine  (b) 

Take  (b) 

Transfer  (b) 

3 .  Solving  problems 


Tasks  in  this  category  have  as  their  central  behaviors  identifying  the 
source  of  the  problem  and  choosing  the  actions  necessary  to  correct  it.  If 
the  actual  correction  of  the  problem  is  likely  to  be  a  major  part  of  the  task, 
then  "following  procedures"  may  be  a  more  appropriate  category.  Identifying 
the  problem  source  usually  involves  a  systematic,  exhaustive  consideration  of 
the  possibilities  with  little  pressure  for  quick  judgments. 


Verb 

Synonyms 

Adapt 

Adjust  (b);  Conform 

Adjust  (b) 

Adapt;  Conform 

Ascertain 

Determine  (a);  Discover 
Confirm;  Verify 

Check  (b) 

Check  out 

Confirm 

Check  (b);  Verify 

Conform 

Adapt;  Adjust  (b) 

Determine  (a) 

Ascertain,  Discover 

Discover 

Ascertain;  Determine  (a) 

Isolate  (a) 

Locate  (a) 

Locate  (a) 

Isolate  (a) 

Revise 

Update 

Update 

Revise 

Verify 

Check  (b);  Confirm 

4 .  Monitoring 

Tasks  in  this  category  have  as  their  central  behavior  careful  watching  or 
listening  for  an  important  signal  against  a  background  of  other,  irrelevant 
signals.  The  task  may  involve  prolonged  attending  to  the  likely  source  of  the 
signal  or  it  may  involve  short  but  careful  examination.  Often  the  frequency 
of  signal  occurrence  and/or  the  signal  to  noise  ratio  is  very  low. 


Verb 

Synonyms 

Acknowledge  (b) 

Answer  (b) 

Answer  (b) 

Acknowledge  (b) 

Acquire 

Detect 

Examine  (b) 

Inspect;  Scrutinize 

Inspect 

Examine  (b);  Scrutinize 

Listen  for 

Monitor  (a) 

Monitor  (b) 

Note  (c) 

Observe  (c);  Watch 

Observe  (c) 

Note  (c);  Watch 

Probe  (b) 

Scrutinize 

Examine  (b);  Inspect 

Watch 

Note  (c);  Observe  (c) 
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5.  Classifying  perceptual,  non-graphic  signals1 

Tasks  in  this  category  have  as  their  central  behavior  recognizing  perceptual 
patterns  as  belonging  to  a  particular  class  or  category.  The  classes  may  be 
general  (friend  or  foe)  or  specific  (F-4).  While  the  signal  to  noise  ratio  is 
usually  high,  the  time  available  for  classifying  may  be  short. 


Verb 

Synonyms 

Classify 

Divide 

Collate  (a) 

Compare 

Collect  (b) 

Compare 

Collate  (a) 

Contrast 

Divide 

Classify 

Identify 

Recognize 

Locate  (b) 

Recognize 

Identify 

Many  action  verbs  indicating  the  process  of  classifying  are  independent  of 
^  the  object  classified.  These  verbs  are  appropriate  both  for  categories  5  and 

6.  To  classify  a  particular  task  when  these  verbs  are  used,  you  must  also 
i  determine  the  nature  of  the  classified  object. 
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b.  Identifying  graphic  symbols 

Tasks  in  this  category  have  as  their  central  behavior  recognizing  and  iden¬ 
tifying  previously  learned  graphic  symbols.  These  symbols  usually  mean  little 
to  untrained  people.  Examples  of  such  symbols  include  electronic  symbols  on  a 
schematic  drawing,  weather  map  symbols,  and  tactical  status  symbols. 


Verb 

Synonyms 

Classify 

Divide 

Collate  (a) 

Compare 

Collate  (b) 

Order  (a) 

Collect  (b) 

Compare 

Collate  (a) 

Contrast 

Divide 

Classify 

Identify 

Order  (a) 

Collate  (b) 

Read  (a) 

Read  (b) 

Recognize 

Identify 

p 

See  note  1 . 
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7.  Communicating  by  voice^ 

Tasks  in  this  category  have  as  their  central  behavior  the  giving  and/or  re¬ 
ceiving  of  information  by  means  of  spoken  language.  The  task  may  involve  the 
use  of  a  specialized  language  or  vocabulary.  Standard  patterns  for  both  the 
message  and  the  response  are  often  specified. 


Verb 


Synonyms 


Acknowledge  (a) 

Acquaint 

Advise 

Alert 

Answer  (a) 

Apprise 

Ask 

Brief 

Call  Ca) 

Call  lb) 

Command 

Communicate  (b) 
Convey  lb) 
Direct  lb) 
Examine  (a) 
Inform 
Instruct 
Interrogate  (a) 
Monitor  <e) 
Notify 
Order  (b) 

Probe  (a) 

Query 
Question 
Reiterate 
Repeat  (a) 

Reply 
Report  (a) 
Report  (b) 
Request 
Respond 
Teach 


Answer  (a) 

Advise;  Apprise;  Brief;  Inform;  Notify 
Acquaint;  Apprise;  Brief;  Inform;  Notify 

Acknowledge 

Acquaint;  Advise;  Brief;  Inform;  Notify 
Query 

Acquaint;  Advise;  Apprise;  Inform;  Notify 

Communicate  (b) 

Direct  (b);  Order  Cb) 

Call  Cb) 

Conmand;  Order  Cb) 

Interrogate  Ca);  Probe  Ca);  Question 
Acquaint;  Advise;  Apprise;  Brief;  Notify 
Teach 

Examine  Ca);  Probe  Ca);  Question 

Acquaint;  Advise;  Apprise;  Brief;  Inform 
Conmand;  Direct  (b) 

Examine  Ca);  Interrogate  la);  Question 
Ask 

Examine  Ca);  Interrogate  (a);  Probe  Ca) 
Repeat  (a) 

Reiterate 

Respond 


Reply 

Instruct 


^Many  action  verbs  indicate  the  process  of  information  transfer  without 
reference  to  the  means  of  transfer.  These  verbs  are  appropriate  both  to 
categories  7  and  d .  These  verbs  may  also  be  appropriate  to  category  9 
although  signaling  is  not  usually  appropriate  to  the  communication  of  large 
quantities  of  information  or  fine  detail.  To  classify  a  particular  task 
when  these  verbs  are  used,  you  must  aiso  determine  the  conmuni cation  process. 
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8.  Communicating  by  writing  or  typing 

Tasks  in  this  category  have  as  their  central  behavior  the  giving  of  infor¬ 
mation  by  means  of  written  or  typed  language.  The  task  may  involve  use  of  a 
specialized  language  or  vocabulary  in  standard  formats.  Tasks  involving  the 
receipt  of  written  information  fall  in  category  6. 


Verb 

Synonyms 

Acknowledge 

(a) 

Answer  (a) 

Acquaint 

Advise;  Apprise;  Brief;  Inform;  Notify 

Advise 

Acquaint;  Apprise;  Brief;  Inform;  Notify 

Alert 

Answer  (a) 

Acknowledge 

Apprise 

Acquaint;  Advise;  Brief;  Inform;  Notify 

Ask 

Query 

Brief 

Communicate 

(b) 

Acquaint;  Advise;  Apprise;  Inform;  Notify 

Convey  (b) 
Enter 

Input;  Load  (a) 

Inform 

Acquaint;  Advise;  Apprise;  Brief;  Notify 

Input 

Enter;  Load  (a) 

Interrogate 
Load  (a) 

(b) 

Enter;  Input 

Log 

Note  (a);  Record  (a) 

Monitor  (c) 
Note  (a) 

Log;  Record  (a) 

Notify 

Acquaint;  Advise;  Apprise;  Brief;  Inform 

Order  (c) 

Requisition 

Query 

Ask 

Record  (a) 

Log;  Note  (a) 

Reply 

Report  (a) 

Respond 

Request 

Requisition 

Order 

Respond 

Type 

Reply 

4 

See  note  3. 


9.  Communicating  non-verbally  (signaling)^ 

Tasks  in  this  category  have  as  their  central  behavior  the  giving  and  re¬ 
ceiving  of  information  through  means  other  than  language,  i.e.,  signals.  The 
signal  vocabulary  may  be  narrow  (6.g.,  go/ no  go;  OK/ trouble)  or  wide  (e,g#f 
semaphore  signals)  or  the  signals  may  have  a  direct  correspondence  to  letters 
[e.g. ,  Morse  code) . 


Verb 

Synonyms 

Acknowledge  (a) 

Alert 

Answer 

Answer  (a) 

Acknowledge 

Ask 

Communicate  (b) 

Monitor  (c) 

Query 

Query 

Ask 

Reply 

Report  (b) 

Respond 

Respond 

Signal 

Reply 

^See  note  3* 
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10.  Following  procedures 

Tasks  in  this  category  have  as  their  central  behavior  following  the  steps 
cf  a  procedure.  A  procedure  is  a  specific  set  of  actions  designed  to  produce  a 
specific  result.  The  steps  may  be  cognitive,  physical,  or  both.  Procedures  may 
be  designed  to  govern  operation  or  repair  of  equipment.  Procedures  involving 
positioning  movements  or  discrete  regulatory  movements  are  more  appropriate  for 
tasks  in  categories  11  and  12,  respectively. 
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1 1 .  Positioning  movements 


Tasks  in  this  category  have  as  their  central  behavior  positioning  movements, 
either  singular  or  in  sequences.  Procedures  involving  positioning  movements  are 
also  in  this  category.  Tasks  involving  cognitive  procedures  are  more  appropriate 
to  category  10.  Tasks  involving  repeated  positioning  movements  which  serve  to 
regulate  some  state  of  the  equipment  should  be  classified  in  category  12. 


Verb 

Synonyms 

Adjust  (a) 

Align 

Line 

Assemble 

Attach 

Connect;  Fasten  (a);  Mate 

Change  (b) 

Replace  (b);  Switch 

Close  (a) 

Shut  (a) 

Close  (b) 

•Connect 

Attach;  Fasten  (a);  Mate 

Disassemble 

Disconnect 

Disjoin 

Disengage  (a) 

Disjoin 

Disconnect 

Divide 

Separate 

Engage  (a) 

Extend 

Reach  (a);  Stretch 

Fasten  (a) 

Attach;  Connect;  Mate 

Insert 

Introduce  (a) 

Install 

Introduce  (a) 

Insert 

Isolate  (b) 

Lay 

Line 

Align 

Load  (c) 

Load  (d) 

Lock  (c) 

Lower 

Mate 

Attach;  Connect;  Fasten  (a) 

Open  (a) 

Open  (b) 

Place 

Position 

Plug  (a) 

Stop  (b) 

Plug  (b) 

Position 

Place 

Raise 

Reach  (a) 

Extend;  Stretch 

Reach  (b) 

Remove  (a) 

Remove  (b) 

Replace  (a) 

Return 

Replace  (b) 

Change  (b);  Switch 

Retract 

Return 

Replace  (a) 

Secure  (a) 

Secure  (b) 
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Verb 

Synonyms 

Separate 

Set 

Set  up 

Divide 

Shut  (a) 

Shut  (b) 

Close  (a) 

Stop  (b) 

Store  (a) 
Store  (b) 

Plug  (a) 

Stretch 

Extend;  Reach  (a) 

Switch 

Throw  (b) 

Change  (b);  Replace  (b) 

12.  Discrete  regulatory  movements 

Tasks  in  this  category  have  as  their  central  behavior  regulatory  movements 
which  are  discrete  in  nature.  That  is,  discrete  movements  rather  than  contin¬ 
uously  variable  movements  are  used  to  control  the  position  or  state  of  the 
equipment.  While  the  controls  are  discrete,  the  state  of  the  system  must  be 
continuously  monitored  and  corrected. 


Verb 


Synonyms 


Acquire 
Control  (a) 
Handle  (a) 
Manage  (b) 
Regulate  (a) 
Wield 


Handle  (a);  Manage  (b);  Regulate  (a) 
Control  (a);  Manage  (b);  Regulate  (a) 
Control  (a);  Handle  (a);  Regulate  (a) 
Control  (a);  Handle  (a);  Manage  (b) 
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13.  Continuous  regulatory  movements 


Tasks  in  this  category  have  as  their  central  behavior  dynamic  perceptual 
motor  coordination  to  keep  the  position  or  state  of  the  equipment  at  a  desired 
value.  Compensating  movements  are  continuously  made  in  response  to  feedback 
from  the  system. 


Verb 


Synonyms 


Check  (a) 
Control  (b) 

Direct  (a) 

Fly 

Guide 

Handle  (c) 

Land 

Maintain  (a) 
Manage  (c) 

Park 

Pass 

Regulate  (b) 

Steer 

Take  off 

Taxi 

Track 


Direct  (a);  Guide;  Handle  (c);  Manage  (c); 
Regulate  (b);  Steer;  Track 
Control  (b);  Guide;  Handle  (c);  Manage  (c); 
Regulate  (b);  Steer 

Control  (b);  Direct  (a);  Handle  (c); 

Manage  (c);  Regulate  (b);  Steer 

Control  (b);  Direct  (a);  Guide;  Manage  (c); 

Regulate  (b);  Steer 


Control  (b);  Direct  (a);  Guide;  Handle  (c); 
Regulate  (b);  Steer 


Control  (b);  Direct  (a);  Guide;  Handle  (c); 
Manage  (c);  Steer 

Control  (b);  Direct  (a);  Guide;  Handle  (c); 
Manage  (c);  Regulate  (b) 


Guide;  Control  (b);  Steer 
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14.  Performing  motor  skills 

Tasks  in  this  category  have  as  their  central  behavior  applying  previously 
learned  motor  skills.  These  skills  must  have  been  learned  to  the  point  that 
procedural  guidelines  are  unnecessary. 

Verb  Synonyms 

Draft 
Finish  (b) 

Sew 

Sharpen 

Splice 

Weld 
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15.  Gross  motor  movements 


Tasks  in  this  category  have  as  their  central  behavior  gross  motor  movements 
The  movements  often  require  strength  and  endurance. 


Verb 

Accumulate 

Apply  (a) 

Carry 

Check  (c) 

Collect  (a) 

Convey 

Depress 

Discharge  (a) 

Drag 

Einpty 

Fill 

Load  (b) 

Loosen 

Press 

Pull  (a) 

Pull  (b) 

Push 

Release  (a) 
Rotate  (a) 
Seize 
Shove 
Take  (a) 

Throw  (a) 

Tighten 

Transfer  (a) 

Transport 

Tug 

Turn 


Synonyms 

Collect  (a) 

Transport 

Accumulate 
Transfer  (a) 
Press 
Einpty 

Pull  (a);  Tug 
Discharge  (a) 
Load  (b) 

Fill 

Depress 
Drag;  Tug 

Shove 

Turn 

Push 


Convey 

Carry 

Drag;  Pull  (a) 
Rotate  (a) 
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ANNEX  D 
Appendix  1 

Glossary  of  Cost  Variables* 


APATRS(i) 

Annual  pay  and  allowances  of  troop  support  (P8  or  P2)  L5.16J 

ASTUPA  (i)  14.18;  5.15J 

Average  annual  pay  and  allowances  of  students  in  year  i. 

BACIMD(i)  L4.1;  4.14;  4.2J 

Total  cost  of  institutional  instructional  material  development  in  year  i. 

BAIMMC(i)  14.1;  4 .15 J 

Total  cost  of  maintenance  of  institutional  instructional  material  in 
year  i. 

BCIMD(i)  L4.14J 

Cost  per  student  in  year  i  for  instructional  material  development. 

BCINST(i)  14.1;  4 .17 J 

Total  cost  of  pay  and  allowances  of  all  instructors  in  institutional 
base  training  in  year  i. 

BCOPMT(i)  L4.13J 

Cost  per  student  of  maintenance  of  variable-cost  institutional  base 
training  equipment  in  year  i. 

BCSQFT(i)  14.11 J 

Cost  per  square  foot  of  operation  and  maintenance  of  training  facilities 
in  year  i  (.includes  operation,  janitorial  service,  utilities,  etc.). 

BCUIMD  L4.15J 

Average  annual  cost  per  student  for  maintenance  of  instructional  material. 
(This  cost  is  assumed  constant  but  could  be  made  variable  on  a  yearly 
basis  by  inserting  the  appropriate  yearly  value  where  used.) 

BDACST(i)  14;  4.1 J 

Total  base  non-discounted  costs  for  year  i. 

BEAQCI(i)  14.1;  4.12;  4.2] 

Total  cost  of  institutional  base  equipment  acquisition  in  year  i. 


•Numbers  in  brackets  indicate  equations  in  which  these  variables  occur. 
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BEM3CIU) 


L4.1;  4.13J 


Total  cost  of  institutional  base  equipment  maintenance  in  year  i. 

BEQCIS(i)  L4.12J 

Total  cost  of  fixed-cost  institutional  base  training  equipment  acquired 
ir.  year  i. 

BEQIMP(i)  14 . 12 J 

Cost  per  student  of  the  variable-cost  institutional  base  training  equipment 
that  must  be  acquired  in  year  i. 

BEQTRS(i)  L4.19J 

Cost  per  student  for  transportation  of  equipment  used  in  institutional 
base  training  in  year  i. 

BFACOS(i)  L4.1;  4.2] 

Total  cost  of  institutional  base  facility  acquisition  in  year  i. 

BFMCOS(i)  [4.1;  4 . 1 1 J 

Total  cost  of  institutional  base  maintenance  of  facilities  in  year  i. 

BINSTR  L4.111;  4.17] 

Ratio  of  instructors  to  students  in  institutional  base  training  (assumed 
constant  from  year  to  year) . 

BOMFEQ(i)  L4.13] 

Cost  of  operation  and  maintenance  of  fixed-cost  institutional  base  training 
equipment  in  year  i  (i.e.,  not  associated  with  the  number  of  students). 

BOVERH(i)  L4.17J 

Cost  per  student  of  institutional  base  operations  overhead  in  year  i. 

BPALIN(i)  14.17] 

Average  annual  pay  and  allowances  of  an  instructor  in  institutional  base 
training  in  year  i. 

BPALST(i)  14. 1;  4.18] 

Total  cost  of  pay  and  allowances  of  students  in  institutional  base  training 
in  year  i. 
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BRORAT(i)  14.17] 

Ratio  of  average  number  of  students  in  initial  training  on  the  particular 
system  to  average  total  number  of  students  in  institutional  base  training 
in  year  i. 

BRVAST  L4;  4.2J 

Remaining  value  of  facilities,  equipment,  and  instructional  materials  at 

end  of  planning  period  (N  years) . 

BSQFST  14.11 1 J 

Number  of  square  feet  of  institutional  base  training  facilities  required 
for  each  student  (assumed  constant  over  entire  planning  period). 

BSQFTA  L4.111] 

Total  square  feet  of  facilities  required  for  administration  associated 

with  initial  training  on  the  system. 

BSUPLY(i)  L4.16] 

Cost  per  student  of  institutional  base  supplies  consumed  in  year  i. 

BSUPPY(i)  L4.1;  4J6J 

Total  cost  of  supplies  consumed  in  year  i  in  institutional  base  training. 

BTIME  L4.17;  4.18] 

Fraction  of  year  spent  by  each  student  in  insstitutional  base  training. 

BTRANS(i)  14.1 ;  4.19] 

Total  cost  of  travel  (including  per  diem)  and  equipment  transportation  in 
connection  with  institutional  training  in  year  i. 

BTRAVL(i)  14.19J 

Cost  per  student  for  travel  (including  per  diem)  in  connection  with 
institutional  base  training  in  year  i. 

BTSQFT(i)  L4.11;  4. Ill] 

Total  square  feet  of  institutional  base  training  facilities  required  in 

year  i . 

BVALUE  12;  3;  4] 

The  total  training  costs  associated  with  institutional  base  training. 
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L4;  5;  6] 

Discount  rate.  DOD  Instruction  7041.3  prescribes  that  the  rate  should  be 
taken  to  10^. 

L4.2;  5.2;  6.2] 

Annual  depreciation  rate  of  equipment (assumes  straight-line  depreciation). 

L4.2;  6 .2 J 

Annual  depreciation  rate  of  facilities  (assumes  straight-line  depreciation) 


FAMMO(i) 


15.13J 


Cost  per  student  of  anmunition  expended  in  institutional  field  training 
in  year  i. 


FCINST(i) 


15. 1;  5.14 J 


Total  cost  of  pay  and  allowances  in  year  i  of  instructors  of  institutional 
field  training. 


FCONSU(i) 


L5.13J 


Cost  per  student  of  miscellaneous  consumables  consumed  in  institutional 
field  training  in  year  i. 


FCOPMT(i) 


15.12] 


Cost  per  student  of  maintenance  of  variable-cost  institutional  field 
training  equipment  in  year  i. 


FDACST(i) 


15,  5.1 J 


Total  non-discounted  cost  of  institutional  field  training  in  year  i, 


FEAQCI(i) 


15. 1;  5.11;  5.2 


Total  cost  of  acquisition  in  year  i  of  equipment  required  for  institutional 
field  training. 


FEMjCI(i) 


L5.1;  5.12J 


Total  cost  in  year  i  of  operation  and  maintenance  of  equipment  required 
for  institutional  field  training. 


FEQIMP(i) 


L5.11] 


Cost  per  student  of  variable-cost  institutional  field  training  equipment 
that  must  be  acquired  in  year  i. 
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FEQCIS(i) 


[5.11] 


i 


Total  cost  of  fixed-cost  institutional  field  training  equipment  acquired 
in  year  i. 

FEQTRS(i)  L5.1 ] 

Total  cost  of  equipment  of  troop  support  units  attributable  to  training 
the  task. 

F1NSTR  L5.14J 

Instructor  to  student  ratio  (assumed  constant). 

FOMFEQ(i)  L5.12J 

Cost  of  operation  and  maintenance  of  fixed-cost  institutional  field 
training  equipment . 

FOMTRS(i)  L5.12J 

Cost  of  operation  and  maintenance  of  troop  support  equipment  attributable 
to  training  the  task. 

FPALIN(i)  L5.14] 

Average  annual  pay  and  allowances  of  an  instructor  in  institutional  field 
training  in  year  i. 

FPALST(i)  L5.1;  5 .15 J 

Total  cost  of  pay  and  allowances  in  year  i  of  students  in  institutional 
field  training. 

FPATRS(i)  L5.1;  5.16] 

Total  cost  of  pay  and  allowances  of  troop  support  (P8  or  P2)  in  year  i 
for  institutional  field  training. 

FPETRO(i)  15.13 J 

Cost  per  student  of  petroleum  products  (POL)  consumed  in  institutional 
field  training  in  year  i. 

FRVAST  15,  5.2J 

Remaining  value  of  equipment  and  instructional  materials  used  in  insti¬ 
tutional  field  training  at  end  of  planning  period. 

FSUPPY(i)  L5.1 ;  5.13J 

Total  cost  of  supplies  consumed  in  year  in  instructional  field  training. 

FTIME  15.14;  5.15] 

Fraction  of  year  spent  by  each  student  in  institutional  field  training. 


D-l-5 


FTRANS(i) 


Total  cost  of  transportation  in  year  i  of  equipment  and  materiel  used 
Institutional  field  training. 

FVALUE  12;  3;  5] 

The  total  training  costs  associated  with  institutional  field  training. 

I AD  L4.2J 

Annual  depreciation  rate  of  instructional  materials  (assumes  straight-line 
depreciation) . 

IVALUE  LI;  2 J 

The  total  training  costs  associated  with  institutional  training. 

M 


Number  of  tasks  contained  in  the  program. 
MESL(i) 


Maximum  expected  student  load. 
METL(i) 


L  7  J 

14. Ill;  4.12; 
4.14;  4 .17 J 


Lb. Ill  J 


Maximum  expected  trainee  load. 


N 

Number  of  years  in  planning  period. 


14;  4.2;  5;  5.2; 
6;  6 . 1 J 


R 


L4.14J 

Number  of  repetitions  of  the  course  in  year  i  (assumed  constant). 


SI(i) 


Average  number  of  students  in  institutional  training 
in  year  i. 


14.13;  4.15;  4.16 
4.17;  4.18;  4.19 
5.11;  5.12;  5.13 
5.14;  5 . 1 5 j 


SQFTIN 


14. 111J 


Number  of  square  feet  of  facilities  required  per  instructor  (assumed 
constant) . 


TU(i)  L6.12;  6.13;  6.14; 

6.15;  6.16;  6.17] 

Number  of  trainees  in  unit  training  in  year  i. 

TVALUE  LI;  3;  7] 

Total  costs  attributable  to  initial  training  on  the  task  or  system  being 
studied. 
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UAMMO(i)  L6.14] 

Cost  per  trainee  of  anmunition  expended  in  unit  training  in  year  i. 

UCONSU(i)  16.14] 

Cost  per  trainee  of  miscellaneous  consumables  consumed  in  unit  training 
in  year  i. 

UCOPMT(i)  Lb. 13 J 

Cost  per  trainee  of  maintenance  of  variable-cost  unit  training  equipment 
in  year  i. 

UCSQFTU)  16.11  J 

Cost  per  square  foot  of  operation  and  maintenance  of  unit  training 
facilities  in  year  i. 

UCTOE(i)  16. 1;  6.16J 

Total  cost  of  p)ay  and  allowances  of  trainees  in  unit  training  in  year  i. 

UCTNR(i)  L6.1;  6.15] 

Total  cost  of  pay  and  allowances  of  all  trainers  in  unit  training  in 
year  i . 

UDACSTCi/  L 6 ;  6.1 J 

Total  non-discounted  cost  of  unit  training  in  year  i. 

UEAQCI(i)  16.1 ;  6.12;  6.2J 

Total  cost  of  unit  training  equipment  acquisition  in  year  i. 

UEM2CIU)  L6.1;  6.13] 

Total  cost  of  unit  training  equipment  maintenance  in  year  i. 

UEQCIS(i)  L6.12J 

Cost  of  fixed-cost  equipment  acquired  for  unit  training  in  year  i. 

UEQIMP(i)  L6.12] 

Cost  per  trainee  of  variable-cost  equipment  used  in  unit  training  in 
year  i. 

UEQTRS(i)  16.17] 

Cost  per  trainee  for  transportation  of  equipment  used  in  unit  training 
in  year  i. 
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^  * 


-i*** 


UFACOS(i) 


16. 1;  6.2] 


Total  cost  of  unit  training  facilities  acquisition  in  year  i. 

UFMCOS(i)  16.1;  6.11] 

Total  cost  of  unit  maintenance  of  training  facilities  in  year  i. 

UOMFEQ(i)  L6.13J 

Cost  of  operation  and  maintenance  of  fixed-cost  unit  training  equipment 
in  year  i. 

UPATNE(i)  L6.16J 

Average  annual  pay  and  allowances  of  trainees  in  unit  training  in  year  i. 

UPATNR(i)  16.15] 

Average  annual  pay  and  allowances  of  a  trainer  in  unit  training  in  year  i. 

(JPETRO(i)  L6.14J 

Cost  per  trainee  of  petroleum  products  (POL]  consumed  in  unit  training 
in  year  i. 

URVAST  16;  6.2J 

Remaining  value  of  facilities,  equipment  and  instructional  materials  used 
in  unit  training  at  end  of  planning  period  (N  years). 

USQFTA  16.111] 

Square  feet  of  administrative  facility  space  required  to  support  unit 
training  on  the  particular  system  being  studied.  If  the  space  would 
be  required  even  if  the  system  were  not  being  trained,  this  variable 
would  be  zero. 

USQFTE  16.111 J 

Square  feet  per  trainee  of  unit  training  facilities  (assumed  constant). 

USCFTR  16.111] 

Square  feet  of  unit  training  facilities  per  trainer  (assumed  constant) . 

USUPPY(i)  16.1;  6.14] 

Total  cost  of  supplies  consumed  in  unit  training  in  year  i. 

UTIME  16.15;  6.16] 

Fraction  of  year  spent  by  each  trainee  in  unit  training  until  SQT 
is  passed. 


UTNRE 


L6.15] 


Trainer  to  trainee  ratio  in  unit  training  (assumed  constant). 

UTRANS(i)  L6.1;  6.17J 

Total  cost  of  travel  (including  per  diem)  and  equipment  transportation 
in  connection  with  unit  training  in  year  i. 

(JTRAVL(i)  L6.17J 

Cost  per  trainee  for  travel  (including  per  diem)  in  connection  with  unit 
training  in  year  i. 

UTSQFT(i)  L6.11;  6.111  J 

Total  square  feet  of  unit  training  facilities  required  in  year  i. 

UVALUE  LI;  3;  6] 

The  total  training  costs  associated  with  unit  training. 
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Appendix  2 

LITTON  COST  MODEL  SUMMARY 


TV ALU F  =  IVALUE  +  UVALUE 

(1) 

IVALUE  =  BVALUE  +  FVALUE 

(2) 

TVALUE  =  BVALUE  +  FVALUE  + 

UVALUE 

(3) 

JL  BDACST(i) 

BRVAST 

BVALUE  =  X 

- 

(4) 

ux  (W1"11 

(1+d)N 

BDACST(i)  =  BFACOS(i)  +  BFMCOS(i)  +  BEAQCl(i)  +  BEMQCI(i)  +  EACIMD(i) 


+  BAIMMC(i)  +  BSUPPY(i)  +  BCINST(i)  +  BPALST(i) 

+  BTRANS(i)  (4.1) 

BFMCOS(i)  =  BTSQFT(i)  •  BCSQFT(i)  (4.11) 

BTSQFT(i)  =  IBSQFST  +  BINSTR  •  SQFTIN]  •  MESL(i)  +  BSQFTA  (4.111) 

BEAQCI(i)  =  BEQIMP(i)  •  MESL(i)  +  BEQCIS(i)  (4.12) 

3EMQCI(i)  =  BCOPMT(i)  •  SI(i)  +  BOMFEQ(i)  (4.13) 

BACIMD(i)  =  BCIMD  •  MESL(i)  •  R  (4.14) 

BAIMMC(i)  =  BCUIMD  •  SI(i)  (4.15) 

BSUPPY(i)  =  BSUPLY(i)  •  SI(i)  (4.16) 

BCINST(i)  =  LBPALIN(i)  •  BINSTR  •  MESL(i)  +  BOVERH(i)  •  BRORAT(i)  (4.17) 

SI(i) J  •  BTIME 

BPALST(i)  =  ASTUPA(i)  •  BTIME  •  SI(i)  (4.18) 

BTRANS(i)  =  BTRAVL(i)  •  SI(i)  +  BEQTRS(i)  (4.19) 
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N 

BRVAST  =  ^  LBFACOS(i) ]  •  [l-(FAD)  (N-i+1]  +  [BEAQCI(i)] 

i=1 

Ll-(EAD)  (N-i+1)]  +  [BACIMD(i) ]  •  [ I-(IAD)  (N-i+1)] 

^  FDACST(i)  FRVAST 

FVALUE  =  2j 

i=1  (i+d)U_1)  (1+d)N 

FDACST(i)  =  FEAQCI(i)  +  FENQCI(i)  +  FSUPPY(i)  +  FCINST(i)  +  FPALST(i) 
+  FPATRS(i)  +  FTRANS(i) 

FEAQCI(i)  =  FEQlMP(i)  •  SI(i)  +  FEQCIS(i)  +  FEQTRS(i) 

FEMQCI ( i )  =  FCOPMT(i)  •  SI(i)  +  FOMFEQ(i)  +  FOMTRS(i) 

FSUPPY(i)  =  LFPETRO(i)  +  FAMMO(i)  +  FCONSU(i)]  •  SI(i) 

FCINST(i)  =  FPALIN(i)  •  FINSTR  •  FTIME  •  SI(i) 

FPALST(i)  =  ASTUPA(i)  •  FTIME  •  5I(i) 

FPATRS(i)  =  APATRS(i)  •  FTIME 
N 

FRVAST  =  ^  LFEAQCI(i) J  •  Ll-(EAD)  (N-i+1)] 
i=1 

,N,  UDACST(i)  URVAST 

UVALUE  =2 

i=1  (1+d)(i"1}  (i+d)N 

UDACST(i)  =  UFACOS(i)  +  UFMCOS(i)  +  UEAQCI(i)  +  UEMQCI(i)  +  USUPPY(i) 

+  UCTNR(i)  +  UCTNE(i)  +  UTRANS(i) 

UFMCOS(i)  =  UTSQFT(i)  •  UCSQFT(i) 

UTSGFT(i)  =  LUSOFST  +  UTNRE  •  USQFTR]  •  METL(i)  +  USQFTA 


(4.2) 

(5) 

(5.1) 

(5.11) 

(5.12) 

(5.13) 

(5.14) 

(5.15) 

(5.16) 

(5.2) 

(b) 

(6.1) 

(6.11) 

(6.111) 
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I 

UEAQCI(i)  =  UEQIMP  ( i )  •  TU(i)  UEQCIS(i) 

UEM3CI(i)  =  UCOPMT(i)  •  TU(i)  +  UOt-FEQ(i) 

USUPPY(i)  =  [UPETRO(i)  +  UAHMO(i)  +  UNCONSU(i)]  •  TU(i) 
UCTNR(i)  =  UPATNR(i)  •  UTNRE  •  UTIME  •  TU(i) 

UCTNE  =  UPATNE(i)  •  UTIME  0  TU(i) 

UTRANS(i)  =  UTRAVL(i)  •  TU(i)  +  UEQTRS(i) 

N 

URVAST  =  ^  LUFACOS(i) ]  *  [l-(FAD)  (N-i+1]  + 
i=1 

LUEAQCl(i)]  *  [l-(EAD)  (N-i-t-1 ) 3 
M 

TPROGR  =  ^  TVALUEj 

j=1 


(6.12) 

(6.13) 

(6.14) 

(6.15) 

(6.16) 
(6.17) 

(6.2) 

(7) 
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Appendix  3  -  Data  Source  Matrix 
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ANNEX  E 
TCA 


TASK  DESCRIPTION 


Appendix  1.  TCA  Worksheet 


Appendix  2 


Examples  of  Reasons  for  Including  Variables  in  a  Task  Description  (adapted 
from  Hawley  and  Thomason ,  1 978 ) . 

Task  31.00  (Perform  Monthly  System  Checks) 


Variable  Type, 

Number  and  Name 

Reason  for  Inclusion 

Stimulus  Variables 

1. 

Visual  Cues 

Visual  inspections  made 

2. 

Audio  Cues 

Auditory  check  of  com.  system 

3. 

Tactile  Cues 

Tactile  switch  checks 

8. 

Visual  Alphanumeric 

KPU  printouts 

9. 

Visual  Symbolic 

CRT  display  checks 

10. 

Visual  Graphic 

CRT  display  checks 

14. 

Visual  Still 

KPU  printouts 

15. 

Visual  Limited  Movement 

Switch  panels  used 

18. 

Black  and  White 

KPU  printouts 

19. 

Gray  Scale 

CRT  display 

24. 

Bright  Visual 

Inspections  made  in  good  light 

26. 

Voice  Sound 

Coo.  System 

30. 

Strong  Audio 

Audio  signals  readily  audible 

32. 

Dynamic  -  Ordered 

Inspection  made  in  specified  order 

34. 

Slow  Rate 

Inspector  proceeds  at  own  speed 

39. 

Group 

Inspection  conducted  by  crew 

Response  Variables 

1. 

Overt  Response  -  Verbal 

Some  voice  responses  required 

2. 

Overt  Response  -  Written 

Record  results  of  system  checks 

3. 

Overt  Response  -  Manipulation 

Use  of  KPU,  switches,  etc. 

5. 

Overt  Response  -  Procedural 

Specified  inspection  procedures 
used 

7. 

Strong  Response  Intensity 

Responses  are  definite 
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s. 

Dynamic  -  Ordered  Response 

Responses  are  sequential 

11. 

Slow  Response  Rate 

inspector  Responds  at  own  rate 

13. 

Limited  Response  Channels 

Response  types  are  specified 

16. 

Group  response 

Inspection  by  crew 

Feedback  Variables 

1. 

Visual  Feedback 

Feedback  from  displays 

3. 

Written  Feedback 

Feedback  from  KPU 

4. 

Face-to-Face  Comm. 

Feedback  from  other  crew  members 

10. 

Intrinsic  Feedback 

Feedback  modes  built  into  sys¬ 
tem 

15. 

System  Status 

Feedback  concerns  system  status 

17. 

Group  Distribution 

Inspection  by  crew 

Methodological  (Functional 

Context)  Variables 

1. 

Supervisory 

Senior  Operator/Repairman  super¬ 
vises 

5. 

Physical 

Inspection  involves  physical 
manipulations 

6. 

Perceptual 

Perception  of  system  responses 
required 

7. 

Communicative 

Communication  between  crew  re¬ 
quired 

9. 

Stable  Function 

Procedure  is  specified  and  un¬ 
changing 

10. 

Low  Physical  Impact 

Procedure  unaffected  by  physical 
environment 

12. 

Low  Psychological  Impact 

Procedure  unaffected  by  psycholo¬ 
gical  environment 

NOTE:  See  Annex  A  (TEEM)  for  descriptions  of  these  variables. 
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LIST  OF  ABBREVIATIONS  AND  ACRONYMS 


ANNEX  F 


LIST  OF  ABBREVIATIONS  AND  ACRONYMS 


AD 

Advanced  Development 

AIT 

Advanced  Individual  Training 

AP 

Acquisition  Plan 

APM 

Army  Program  Memorandum 

AR 

Army  Regulation 

ARTEP 

Army  Training  and  Evaluation  Program 

AS  ARC 

Army  Systems  Acquisition  Review  Council 

ASI 

Additional  Skill  Identifier 

ATM 

Analogous  Task  Method 

ATSC 

Army  Training  Support  Center  (Fort  Eustis,  VA) 

BDM/CARAF 

The  3DM  Service  Company  Combined  Arms  Research  and 
Analysis  Facility 

BOIP 

Basis  of  Issue  Plan 

EOIPT 

Basis  of  Issue  Plan  -  Tentative 

BT 

Basic  Training 

CDB 

Consolidated  Data  Base 

C/E 

Cost  Effectiveness 

CFP 

Concept  Formulation  Package 

CHRT 

Coordinated  Human  Resources  Technology 

COEA 

Cost  and  Operational  Effectiveness  Analysis 

COI 

Course  of  Instruction 

COIP 

Consequenbe  of  Inadequate  Performance 

CRT 

Cathode  Ray  Tube 

CTEA 

Cost  and  Training  Effectiveness  Analysis 

DA 

Department  of  the  Army 
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DARCOM 


DCD 

DCP 

DIO 

DP 

DRIMS 

DSARC 

DT 

DT/OT 

DTD 

EE  A 

FYDP 

HRDT 

ILS 

IPR 

IPS 

IRTA 

ISD 

ISP 

ITC 

ITDT 

IT? 

ITV 

JGD 

LCC 

LCCE 

LCSMM 


U.S.  Army  Materiel  Development  and  Readiness  Comnand 
Department  of  Combat  Developments 
Decision  Coordinating  Paper 
Director  of  Industrial  Operations 
Development  Plan 

Diagnostic  Rifle  Marksmanship  Simulators 
Defense  System  Acquisition  Review  Council 
Development  Test 

Development  Test/Operational  Test 

Directorate  of  Training  Developments 

Essential  Elements  of  Analysis 

Five  Year  Defense  Plan 

Human  Resources  in  Design  Trade-Offs 

Integrated  Logistic  Support 

In-Process  Review 

Integrated  Personnel  Support 

Integrated  Requirements  and  Tasks  Analysis 

Instructional  Systems  Development 

Integrated  Support  Plan 

Institutional  Training  Cost 

Integrated  Technical  Documentation  and  Training 

Individual  Training  Plan 

Improved  TOW  Vehicle 

Job  Guide  Development 

Life  Cycle  Costs 

Life  Cycle  Cost  Elements 

Life  Cycle  System  Management  Model 
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LOA 

LOGCEN 

LR 

LSA 

LSAR 

MENS 

MILPERCEN 

M4M 

MOS 

MODIA 

MOD 

MOTE 

MPA 

NET 

OAP 

ODP 

pICTP 

OJT 

OMA 

OSUT 

OT 

Ph 

PIP 

PM 

PCI 

POL 

PPI 


Letter  of  Agreement 

Logistics  Center 

Letter  Requirement 

Logistic  Support  Analysis 

Logistic  Support  Analysis  Record 

Mission  Element  Needs  Statement 

Military  Personnel  Center 

Maintenance  Manpower  Modeling 

Military  Occupational  Specialty 

Method  of  Designing  Instruction  Alternatives 

Modification 

Measures  of  Training  Effectiveness 

Military  Personnel,  Army 

New  Equipment  Training 

Outline  Acquisition  Plan 

Outline  Development  Plan 

Outline  Individual  Collective  Training  Plan 

On-the-job  Training 

Operations  and  Maintenance,  Army 

One  Station  Unit  Training 

Operational  Test 

Probability  of  Hit 

Product  Improvement  Program 

Project/Program/Product  Manager 

Program  of  Instruction 

Petroleun,  Oil  and  Lubricants 

Plan  Position  Indicator 
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PQOPRI 

FROC 

QQPRI 

RAM 
RDTE 
RFA 
ROC 
RTE 
RUM 
SAT 
SOC 
SQT 
TASA 
TASC 
TASO 
TAEG 
TCA 
TCF 
\TEC 
TEOEP 
TDDA  ^ 
TDIS 
TDP 
TDT 
TEEM 
TLD 


Provisional  Qualitative  and  Quantitative  Personnel 
Requirements  Information 

Procurement 

Qualitative  and  Quantitative  Personnel  Requirements 
Information 

Reliability,  Availability,  Maintainability 
Research,  Development,  Test  and  Evaluation 
Rimfire  Adapter 

Required  Operational  Capability 

Relative  Training  Effectiveness 

Resource  Utilization  Model 

Systems  Approach  to  Training 

System  Ownership  Cost 

Skill  Qualification  Test 

Task  and  Skill  Analysis 

Training  Aids  Service  Center 

Training  Aids  Service  Office 

Training  Analysis  and  Evaluation  Group 

Training  Consonance  Analysis 

Training  Consonance  Ratio 

Training  Extension  Course 

Training  Evaluation  Cost  Evaluation  Program 

Training  Developers  Decision  Aid 

Training  Developments  Information  System 

Training  Device  Requirement 

Task  Delay  Tolerance 

Training  Efficiency  Estimation  Model 

Task  Learning  Difficulty 
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TM 


Technical  Manual 


TMON 

TOCI 

TOE 

TQQPKI 

TRADOC 

TRAINVICE 

TRAM 

TRAMOD 

TSD 

TSM 

ill/ 

UI 

UTC 

WSTEA 


Technical  Manual  on 

Training  Option  Cost  Indicator 

Table  of’ Organization  ana  Equipment 

Tentative  Qualitative  and  Quantitative  Personnel 
Requirements  Information 

Training  and  Doctrine  Command 

Training  Device  Effectiveness  Model 

Training  Analysis  Model 

Training  Requirements  Analysis  Model 

Training  System  Design 

TRADOC  System  Manager 

Total  Training  Cost 

User  Interface 

Unit  Training  Cost 

Weapon  System  Effectiveness  Analysis 
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DEFENSE  LOGISTICS  AGENCY 

DEFENSE  DOCUMENTATION  CENTER 
CAMERON  STATION 
ALEXANDRIA,  VIRGINIA  22314 


IN  reply  DTIC-DDA-1  R8100951  5  May  81 

refer  to  (AC  202-274-6847  or  AUTOVON  28-46847) 


SUBJECT:  Request  for  Scientific  and  Technical  Reports 


Da  Army  Rsch  Inst  (PTRL) 
FT  Bliss  Fid  Unit 
FT  Bliss,  TX  79916 
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5.  If  for  any  reason  you  cannot  furnish  the  report,  please  return  the  copy  of  this  letter  annotating  your  reason  on  the  reverse  side. 
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